[ 628.061513] env[69847]: INFO neutron.common.config [-] Logging enabled! [ 628.061765] env[69847]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev71 [ 628.061958] env[69847]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69847) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 628.062267] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 628.062381] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 628.063193] env[69847]: WARNING oslo_policy.policy [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 628.063418] env[69847]: WARNING oslo_policy.policy [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 628.064872] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] VMware NSXv3 Agent initialized successfully. [ 628.065247] env[69847]: DEBUG oslo_concurrency.lockutils [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] Acquiring lock "singleton_lock" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.065385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] Acquired lock "singleton_lock" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.065590] env[69847]: DEBUG oslo_concurrency.lockutils [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] Releasing lock "singleton_lock" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.065877] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] Full set of CONF: {{(pid=69847) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 628.066105] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ******************************************************************************** {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 628.066227] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] Configuration options gathered from: {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 628.066476] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 628.066659] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 628.066771] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ================================================================================ {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 628.066945] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] agent_down_time = 75 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067128] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] allow_automatic_dhcp_failover = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067253] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] allow_bulk = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067402] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] api_extensions_path = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067547] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] api_paste_config = api-paste.ini {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067692] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] auth_strategy = keystone {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067803] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] backdoor_port = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.067910] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] backdoor_socket = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068065] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] backlog = 4096 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068210] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068373] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] bind_host = 0.0.0.0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068529] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] bind_port = 9696 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068654] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] client_socket_timeout = 900 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068796] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] config_dir = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.068910] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.069064] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] config_source = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.069222] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] control_exchange = neutron {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.069384] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] core_plugin = ml2 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.069537] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] debug = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.069681] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] default_availability_zones = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.069898] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070063] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] dhcp_agent_notification = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070222] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] dhcp_agents_per_network = 1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070401] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] dhcp_lease_duration = 86400 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070564] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] dhcp_load_type = networks {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070711] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] dns_domain = openstacklocal {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070853] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.070998] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_default_route_bfd = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071154] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_default_route_ecmp = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071294] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_dvr = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071436] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_new_agents = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071572] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071709] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_signals = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071846] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] enable_traditional_dhcp = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.071978] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] external_dns_driver = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.072129] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] filter_validation = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.072277] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] global_physnet_mtu = 8950 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.072418] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] graceful_shutdown_timeout = 60 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.072593] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] host = cpu-1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.072974] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] host_dvr_for_dhcp = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.072974] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] http_retries = 3 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073119] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] instance_format = [instance: %(uuid)s] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073147] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073292] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ipam_driver = internal {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073434] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ipv6_pd_enabled = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073570] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] l3_ha = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073724] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073851] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] l3_ha_network_physical_name = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.073988] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] l3_ha_network_type = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074144] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_color = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074283] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_config_append = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074425] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074559] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_dir = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074691] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_file = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074799] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_options = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.074938] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_rotate_interval = 1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075270] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_rotate_interval_type = days {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075270] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] log_rotation_type = none {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075367] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075437] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075581] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075725] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075821] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.075963] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] max_dns_nameservers = 5 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.076114] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] max_header_line = 16384 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.076253] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] max_l3_agents_per_router = 3 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.076390] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] max_logfile_count = 30 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.076526] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] max_logfile_size_mb = 200 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.076756] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] max_subnet_host_routes = 20 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.076884] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] my_ip = 10.180.1.21 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077041] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] my_ipv6 = ::1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077184] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] network_auto_schedule = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077318] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] network_link_prefix = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077464] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077610] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] notify_nova_on_port_data_changes = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077754] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] notify_nova_on_port_status_changes = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.077900] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] pagination_max_limit = -1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.078053] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] publish_errors = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.078193] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] rate_limit_burst = 0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.078337] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] rate_limit_except_level = CRITICAL {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.078479] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] rate_limit_interval = 0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.078617] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] retry_until_window = 30 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.078756] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] router_distributed = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079072] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] rpc_resources_processing_step = 20 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079072] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] rpc_response_max_timeout = 600 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079205] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] rpc_response_timeout = 60 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079345] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] send_events_interval = 2 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079502] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] service_plugins = ['router'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079650] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] setproctitle = on {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079924] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] shell_completion = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.079924] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] state_path = /opt/stack/data/neutron {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080072] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] syslog_log_facility = LOG_USER {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080220] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] tcp_keepidle = 600 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080382] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] transport_url = **** {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080533] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] use_journal = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080673] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] use_json = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080810] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] use_ssl = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.080946] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] use_stderr = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081103] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] use_syslog = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081243] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] vlan_qinq = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081381] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] vlan_transparent = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081520] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] watch_log_file = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081660] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] wsgi_default_pool_size = 100 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081796] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] wsgi_keep_alive = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.081938] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.082089] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] wsgi_server_debug = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 628.082248] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_concurrency.disable_process_locking = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.082401] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.082551] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.082692] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.082969] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.082969] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.083135] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.083291] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.connection_string = messaging:// {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.083442] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.enabled = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.083733] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.es_doc_type = notification {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.083733] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.es_scroll_size = 10000 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.083872] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.es_scroll_time = 2m {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084021] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.filter_error_trace = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084180] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.hmac_keys = **** {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084375] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.sentinel_service_name = mymaster {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084458] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.socket_timeout = 0.1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084599] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.trace_requests = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084743] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler.trace_sqlalchemy = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.084897] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler_jaeger.process_tags = {} {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.085049] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler_jaeger.service_name_prefix = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.085195] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] profiler_otlp.service_name_prefix = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.085351] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.enforce_new_defaults = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.085629] env[69847]: WARNING oslo_config.cfg [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 628.085782] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.enforce_scope = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.085929] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.policy_default_rule = default {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.086102] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.086253] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.086430] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.086539] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.086677] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087116] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087116] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087116] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087288] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087450] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] agent.extensions = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087601] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087753] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] service_providers.service_provider = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.087906] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.default_quota = -1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088072] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088220] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_floatingip = 50 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088364] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_network = 100 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088505] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_port = 500 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088645] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088786] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_router = 10 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.088926] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_security_group = 10 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089258] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089258] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.quota_subnet = 100 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089380] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] QUOTAS.track_quota_usage = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089537] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089679] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep.group = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089817] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep.helper_command = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.089961] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090119] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep.thread_pool_size = 8 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090261] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep.user = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090465] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090569] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_dhcp_release.group = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090706] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_dhcp_release.helper_command = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090848] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.090989] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091192] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_dhcp_release.user = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091276] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091414] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_ovs_vsctl.group = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091547] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091692] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091833] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.091967] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_ovs_vsctl.user = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092126] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_namespace.capabilities = [21] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092261] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_namespace.group = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092440] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_namespace.helper_command = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092537] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092680] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092817] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_namespace.user = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.092963] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_conntrack.capabilities = [12] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093112] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_conntrack.group = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093259] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_conntrack.helper_command = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093389] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093636] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093751] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_conntrack.user = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093816] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_link.capabilities = [12, 21] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.093933] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_link.group = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094093] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_link.helper_command = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094211] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094350] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_link.thread_pool_size = 8 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094500] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] privsep_link.user = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094635] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094862] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.094920] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.continue_on_failed_promotions = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.095070] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.dscp = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.095209] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.dscp_inherit = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.095374] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.force_mp_to_policy = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.095525] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.locking_coordinator_url = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.095686] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.log_agent_heartbeats = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.095824] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.logging_expire = 1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096068] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096130] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096273] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.polling_interval = 240 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096426] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096585] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096733] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.report_interval = 30.0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.096903] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097030] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097293] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097351] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.sync_skew = 60 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097492] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.synchronization_queue_size = 20 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097641] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT.use_helper_for_ns_read = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097790] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] SECURITYGROUP.enable_ipset = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.097941] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] SECURITYGROUP.enable_security_group = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098100] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098249] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098398] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] experimental.ipv6_pd_enabled = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098558] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.extension_drivers = ['port_security'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098696] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.external_network_type = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098849] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.098999] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.overlay_ip_version = 4 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.099164] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.path_mtu = 8950 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.099344] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.physical_network_mtus = {} {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.099497] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.099647] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.099796] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ml2.type_drivers = ['vlan'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.099946] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.100103] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.100256] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.100423] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.100578] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.100726] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.100875] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.101033] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.101184] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.101378] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.101532] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_login_password = **** {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.101684] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.101827] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_login_user = admin {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102127] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102127] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102272] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102415] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102598] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102710] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.102857] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103014] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103162] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103311] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103493] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103647] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103799] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.103992] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.104162] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.104367] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.104512] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.104618] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.auth_section = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.104750] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.auth_type = password {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.104895] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105046] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.certfile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105191] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.collect_timing = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105342] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.endpoint_type = public {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105487] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.insecure = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105624] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.keyfile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105772] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.region_name = RegionOne {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.105916] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.split_loggers = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106066] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] nova.timeout = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106214] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.auth_section = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106367] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.auth_type = password {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106512] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106650] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.certfile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106792] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.collect_timing = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.106939] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.endpoint_type = public {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107107] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.insecure = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107240] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.keyfile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107399] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.region_name = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107525] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.split_loggers = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107662] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] placement.timeout = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107806] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.auth_section = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.107945] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.auth_type = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108095] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.cafile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108233] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.certfile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108377] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.collect_timing = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108514] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.connect_retries = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108650] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.connect_retry_delay = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108791] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.enable_notifications = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.108929] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.endpoint_override = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109082] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.insecure = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109238] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.interface = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109386] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.keyfile = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109527] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.max_version = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109666] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.min_version = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109800] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.region_name = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.109934] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.retriable_status_codes = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110079] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.service_name = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110358] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.service_type = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110426] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.split_loggers = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110547] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.status_code_retries = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110685] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.status_code_retry_delay = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110831] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.timeout = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.110957] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.valid_interfaces = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.111105] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ironic.version = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.111253] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] cli_script.dry_run = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.111408] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.111567] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.111744] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.111891] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112047] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112188] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112330] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112472] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112612] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112761] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.112902] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113062] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113213] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113358] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113499] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113646] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113787] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.113927] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114085] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114251] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114391] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114547] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114690] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114831] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.114973] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115129] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115272] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115417] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115561] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115703] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115848] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.ssl = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.115999] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.116160] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.116303] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.116450] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.116593] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.116733] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.116885] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_notifications.driver = [] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.117039] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_notifications.retry = -1 {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.117199] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.117360] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 628.117501] env[69847]: DEBUG oslo_service.backend.eventlet.service [None req-44e7bf95-80aa-42c4-8ad5-76fc7b626222 None None] ******************************************************************************** {{(pid=69847) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 628.118433] env[69847]: DEBUG neutron.agent.securitygroups_rpc [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Init firewall settings (driver=nsxv3) {{(pid=69847) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 628.119750] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69847) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 628.119986] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] RPC agent_id: nsxm-l-01a.corp.local [ 628.122205] env[69847]: DEBUG dogpile.cache.region [None req-75e223ae-d828-4210-922b-7433d133c789 None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.122331] env[69847]: DEBUG dogpile.lock [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.122430] env[69847]: DEBUG dogpile.lock [None req-75e223ae-d828-4210-922b-7433d133c789 None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.122526] env[69847]: DEBUG dogpile.lock [None req-75e223ae-d828-4210-922b-7433d133c789 None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.122623] env[69847]: DEBUG dogpile.cache.region [None req-75e223ae-d828-4210-922b-7433d133c789 None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.122727] env[69847]: DEBUG dogpile.lock [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.122834] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.141136] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Session token - acquiring [ 628.142586] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.142784] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.142864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.143277] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.154000] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.412541] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 628.432893] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.433093] env[69847]: DEBUG dogpile.cache.region [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Cache value generated in 0.310 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 628.433191] env[69847]: DEBUG dogpile.lock [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.433262] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Activating Policy API Provider. [ 628.433508] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Looking for the default Infrastructure Rules. [ 628.495152] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Looking for the Default Layer3 Logged Drop Section. [ 628.507926] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 628.508144] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.508310] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.508416] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.508686] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.509443] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-75e223ae-d828-4210-922b-7433d133c789 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.023948] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-75e223ae-d828-4210-922b-7433d133c789 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.525494] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-75e223ae-d828-4210-922b-7433d133c789 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.029085] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Inventory metadata is going to be refreshed. [ 630.029085] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 631.031710] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.032244] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.032244] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.032382] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.146690] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 631.147629] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.148516] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 631.165523] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.165778] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.165778] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.166100] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.166232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.166377] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 631.166496] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.166604] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 631.188114] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.188368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.188368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.188665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.188842] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.188988] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 631.208804] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.209071] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.209071] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.209378] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.209632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.209792] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 631.231553] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.231837] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.231837] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.232109] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.232255] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.232405] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 631.232511] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.232616] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 631.251485] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.251715] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.251779] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.252010] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.252138] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.252281] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 631.252386] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.252491] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 631.271223] env[69847]: DEBUG networking_nsxv3.common.locking [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.271458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.271458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.271727] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.271866] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.272019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 631.272128] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 631.272242] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Inventory metadata have been refreshed. [ 631.272325] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Dryrun:True. Metadata refresh completed. [ 631.272450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Releasing lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.274085] env[69847]: INFO neutron.agent.agent_extensions_manager [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Loaded agent extensions: [] [ 631.274786] env[69847]: DEBUG neutron_lib.callbacks.manager [None req-75e223ae-d828-4210-922b-7433d133c789 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69847) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 631.330504] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent RPC Daemon Started! [ 631.330683] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:0 started [ 631.330719] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent out of sync with plugin! [ 636.275069] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 636.275411] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 641.276191] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 641.276601] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 645.020236] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6e307e48-7c45-4d33-85ce-97766a865867 demo admin] Enqueued Resource ID: eaf5623c-dacb-48e8-97b7-ae5744c57dce with Priority: HIGHEST for action security_group_rules [ 645.020655] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf5623c-dacb-48e8-97b7-ae5744c57dce with Priority: HIGHEST for action security_group_rules [ 645.020948] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaf5623c-dacb-48e8-97b7-ae5744c57dce taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.021088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaf5623c-dacb-48e8-97b7-ae5744c57dce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.021157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaf5623c-dacb-48e8-97b7-ae5744c57dce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.021489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaf5623c-dacb-48e8-97b7-ae5744c57dce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.021577] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaf5623c-dacb-48e8-97b7-ae5744c57dce',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.539918] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.540146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.540146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.540330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.540425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.540507] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaf5623c-dacb-48e8-97b7-ae5744c57dce already deleted. [ 645.540591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaf5623c-dacb-48e8-97b7-ae5744c57dce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.278250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.278720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.278720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.278720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.278902] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.784370] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.286244] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.789168] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 647.789357] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 648.469809] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.470210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.470210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.470210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.481893] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 648.482669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.483244] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 648.498908] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.499062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.499144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.499272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.499354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.499477] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 648.499557] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 648.499627] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 648.516725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.516862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.516897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.517080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.517201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.517297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 648.535716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.535880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.535880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.536047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.536139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.536232] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 648.552266] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.552385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.552454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.552585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.552674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.552773] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 648.552844] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 648.552911] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 648.567230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.567393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.567393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.567560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.567643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.567734] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 648.567805] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 648.567873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 648.592786] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.592900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.592978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.593124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.593213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.593312] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 648.593382] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 648.593449] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 648.593512] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 648.593581] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 648.593641] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 648.593704] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 648.593938] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 648.594012] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 648.594081] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 648.612105] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.612225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.612347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.612433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.612524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.612620] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 648.630158] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.630309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.630309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.630488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.630592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.641651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.022346] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 650.022735] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 655.023923] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 655.023923] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 660.025072] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 660.025072] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 665.027041] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 665.027041] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 670.027867] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 670.028227] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 670.448903] env[69847]: INFO networking_nsxv3.common.synchronization [None req-486da395-807d-4e4b-b75e-0413a4ac962a None None] Enqueued Resource ID: cf6941ac-3178-439e-b87e-a4991fd131a0 with Priority: HIGHEST for action port [ 670.449535] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf6941ac-3178-439e-b87e-a4991fd131a0 with Priority: HIGHEST for action port [ 670.450245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf6941ac-3178-439e-b87e-a4991fd131a0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.451224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf6941ac-3178-439e-b87e-a4991fd131a0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.451295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf6941ac-3178-439e-b87e-a4991fd131a0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.451563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf6941ac-3178-439e-b87e-a4991fd131a0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.451644] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf6941ac-3178-439e-b87e-a4991fd131a0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.917040] env[69847]: INFO networking_nsxv3.common.synchronization [None req-910b723c-9553-4562-b427-d9e85317348f None None] Enqueued Resource ID: 3c486592-c343-4eaa-ae23-45be3d8820ef with Priority: HIGHEST for action port [ 670.917040] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c486592-c343-4eaa-ae23-45be3d8820ef with Priority: HIGHEST for action port [ 670.917252] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c486592-c343-4eaa-ae23-45be3d8820ef taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.917648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c486592-c343-4eaa-ae23-45be3d8820ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.917825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c486592-c343-4eaa-ae23-45be3d8820ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.918247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c486592-c343-4eaa-ae23-45be3d8820ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.921813] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c486592-c343-4eaa-ae23-45be3d8820ef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.955444] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf6941ac-3178-439e-b87e-a4991fd131a0 [ 670.955668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.955807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.955874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.956091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.956177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.956265] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf6941ac-3178-439e-b87e-a4991fd131a0 already deleted. [ 670.956340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf6941ac-3178-439e-b87e-a4991fd131a0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.424870] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c486592-c343-4eaa-ae23-45be3d8820ef [ 671.424870] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.424870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.424870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.425272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.425272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.425272] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c486592-c343-4eaa-ae23-45be3d8820ef already deleted. [ 671.425367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c486592-c343-4eaa-ae23-45be3d8820ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.615696] env[69847]: INFO networking_nsxv3.common.synchronization [None req-3722b863-1a51-4fa9-b23d-1b1cd31b9a0d None None] Enqueued Resource ID: 219c2dac-10ba-446d-a104-15db8dc07bee with Priority: HIGHEST for action port [ 671.615992] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 219c2dac-10ba-446d-a104-15db8dc07bee with Priority: HIGHEST for action port [ 671.616560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-219c2dac-10ba-446d-a104-15db8dc07bee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.616683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-219c2dac-10ba-446d-a104-15db8dc07bee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.616753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-219c2dac-10ba-446d-a104-15db8dc07bee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.616998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-219c2dac-10ba-446d-a104-15db8dc07bee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.617092] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('219c2dac-10ba-446d-a104-15db8dc07bee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.119889] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 219c2dac-10ba-446d-a104-15db8dc07bee [ 672.120138] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.120278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.120412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.120564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.120651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.120749] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:219c2dac-10ba-446d-a104-15db8dc07bee already deleted. [ 672.120830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-219c2dac-10ba-446d-a104-15db8dc07bee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.958648] env[69847]: INFO networking_nsxv3.common.synchronization [None req-df6f09d9-297f-4b88-afcb-aa7dec053154 None None] Enqueued Resource ID: 16d0a035-2a0a-4cfd-a318-381044fc1e24 with Priority: HIGHEST for action port [ 672.958995] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16d0a035-2a0a-4cfd-a318-381044fc1e24 with Priority: HIGHEST for action port [ 672.959307] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-16d0a035-2a0a-4cfd-a318-381044fc1e24 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.959423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16d0a035-2a0a-4cfd-a318-381044fc1e24" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.959488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16d0a035-2a0a-4cfd-a318-381044fc1e24" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.959750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16d0a035-2a0a-4cfd-a318-381044fc1e24" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.959878] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16d0a035-2a0a-4cfd-a318-381044fc1e24',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.962821] env[69847]: INFO networking_nsxv3.common.synchronization [None req-01e800d0-7e39-4a55-8a50-78d85abe1a3e None None] Enqueued Resource ID: 2f7dec6c-eac9-426e-bdbc-9cd03c1106c2 with Priority: HIGHEST for action port [ 672.963034] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7dec6c-eac9-426e-bdbc-9cd03c1106c2 with Priority: HIGHEST for action port [ 672.963406] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f7dec6c-eac9-426e-bdbc-9cd03c1106c2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.963517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f7dec6c-eac9-426e-bdbc-9cd03c1106c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.963731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f7dec6c-eac9-426e-bdbc-9cd03c1106c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.963792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f7dec6c-eac9-426e-bdbc-9cd03c1106c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.963862] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f7dec6c-eac9-426e-bdbc-9cd03c1106c2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.463343] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16d0a035-2a0a-4cfd-a318-381044fc1e24 [ 673.463343] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.463343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.463343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.463343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.463343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.463343] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16d0a035-2a0a-4cfd-a318-381044fc1e24 already deleted. [ 673.463343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16d0a035-2a0a-4cfd-a318-381044fc1e24" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.467633] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f7dec6c-eac9-426e-bdbc-9cd03c1106c2 [ 673.467633] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.467791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.467791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.467953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.468512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.468512] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f7dec6c-eac9-426e-bdbc-9cd03c1106c2 already deleted. [ 673.468512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f7dec6c-eac9-426e-bdbc-9cd03c1106c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.654907] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b1962dc9-685e-4b1f-8ba4-b71c689b4546 None None] Enqueued Resource ID: d9d35592-1330-4d47-9bc9-86eaa75073e3 with Priority: HIGHEST for action port [ 673.657076] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d35592-1330-4d47-9bc9-86eaa75073e3 with Priority: HIGHEST for action port [ 673.657274] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9d35592-1330-4d47-9bc9-86eaa75073e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.657618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9d35592-1330-4d47-9bc9-86eaa75073e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.657803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9d35592-1330-4d47-9bc9-86eaa75073e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.658901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9d35592-1330-4d47-9bc9-86eaa75073e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.658901] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d35592-1330-4d47-9bc9-86eaa75073e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.160775] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9d35592-1330-4d47-9bc9-86eaa75073e3 [ 674.161127] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.161127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.161297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.161457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.161573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.161672] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9d35592-1330-4d47-9bc9-86eaa75073e3 already deleted. [ 674.161754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9d35592-1330-4d47-9bc9-86eaa75073e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.611469] env[69847]: INFO networking_nsxv3.common.synchronization [None req-2178c479-8113-4e92-bc78-a09ec30dcbbf None None] Enqueued Resource ID: 031d543e-ac6e-49dd-aee8-f47f51d536af with Priority: HIGHEST for action port [ 676.611709] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 031d543e-ac6e-49dd-aee8-f47f51d536af with Priority: HIGHEST for action port [ 676.612545] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-031d543e-ac6e-49dd-aee8-f47f51d536af taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.613226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-031d543e-ac6e-49dd-aee8-f47f51d536af" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.613226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-031d543e-ac6e-49dd-aee8-f47f51d536af" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.613226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-031d543e-ac6e-49dd-aee8-f47f51d536af" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.613226] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('031d543e-ac6e-49dd-aee8-f47f51d536af',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.115340] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 031d543e-ac6e-49dd-aee8-f47f51d536af [ 677.115340] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.115606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.115606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.115744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.116529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.118044] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:031d543e-ac6e-49dd-aee8-f47f51d536af already deleted. [ 677.118178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-031d543e-ac6e-49dd-aee8-f47f51d536af" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.354246] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9064e1f2-ec1b-4300-ae5c-b5655802af87 None None] Enqueued Resource ID: 3bbdf461-ccc1-4b31-9377-a31a5eca859d with Priority: HIGHEST for action port [ 678.354729] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bbdf461-ccc1-4b31-9377-a31a5eca859d with Priority: HIGHEST for action port [ 678.355030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bbdf461-ccc1-4b31-9377-a31a5eca859d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.355151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bbdf461-ccc1-4b31-9377-a31a5eca859d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.355216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bbdf461-ccc1-4b31-9377-a31a5eca859d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.355463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bbdf461-ccc1-4b31-9377-a31a5eca859d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.355538] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bbdf461-ccc1-4b31-9377-a31a5eca859d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.865020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3bbdf461-ccc1-4b31-9377-a31a5eca859d [ 678.865020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.865020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.865020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.865020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.865020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.865020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3bbdf461-ccc1-4b31-9377-a31a5eca859d already deleted. [ 678.865020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bbdf461-ccc1-4b31-9377-a31a5eca859d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.932198] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7a8898b9-2038-4cc3-ba1f-31d101a36adb None None] Enqueued Resource ID: c8c58fdc-99a1-4d21-beb3-17845007b639 with Priority: HIGHEST for action port [ 678.932699] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c58fdc-99a1-4d21-beb3-17845007b639 with Priority: HIGHEST for action port [ 678.935483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c58fdc-99a1-4d21-beb3-17845007b639 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.935483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c58fdc-99a1-4d21-beb3-17845007b639" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.935483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c58fdc-99a1-4d21-beb3-17845007b639" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.937472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c58fdc-99a1-4d21-beb3-17845007b639" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.937660] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c58fdc-99a1-4d21-beb3-17845007b639',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.326285] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ab416f94-ca88-429a-96e4-7ccaae5f9137 None None] Enqueued Resource ID: 0adff376-c33f-461b-b454-c0f1e3c4a740 with Priority: HIGHEST for action port [ 679.326839] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0adff376-c33f-461b-b454-c0f1e3c4a740 with Priority: HIGHEST for action port [ 679.326915] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-0adff376-c33f-461b-b454-c0f1e3c4a740 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.327777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0adff376-c33f-461b-b454-c0f1e3c4a740" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.327896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0adff376-c33f-461b-b454-c0f1e3c4a740" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.328162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0adff376-c33f-461b-b454-c0f1e3c4a740" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.328244] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0adff376-c33f-461b-b454-c0f1e3c4a740',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.441498] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8c58fdc-99a1-4d21-beb3-17845007b639 [ 679.441498] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.441498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.443448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.443448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.443448] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8c58fdc-99a1-4d21-beb3-17845007b639 already deleted. [ 679.443448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c58fdc-99a1-4d21-beb3-17845007b639" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.833526] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0adff376-c33f-461b-b454-c0f1e3c4a740 [ 679.835316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.836037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.836037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.836037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.836037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.836037] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0adff376-c33f-461b-b454-c0f1e3c4a740 already deleted. [ 679.836327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0adff376-c33f-461b-b454-c0f1e3c4a740" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.854876] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d54731a9-bc6c-424c-b09a-649e399a934c None None] Enqueued Resource ID: 0622f2ee-a32a-4cbc-ac0b-33dc3141be7e with Priority: HIGHEST for action port [ 679.854876] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0622f2ee-a32a-4cbc-ac0b-33dc3141be7e with Priority: HIGHEST for action port [ 679.856762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-0622f2ee-a32a-4cbc-ac0b-33dc3141be7e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.856762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0622f2ee-a32a-4cbc-ac0b-33dc3141be7e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.856762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0622f2ee-a32a-4cbc-ac0b-33dc3141be7e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.856762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0622f2ee-a32a-4cbc-ac0b-33dc3141be7e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.857245] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0622f2ee-a32a-4cbc-ac0b-33dc3141be7e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.235760] env[69847]: INFO networking_nsxv3.common.synchronization [None req-1bd23e5d-9a65-4184-a0da-dd337ae1551d None None] Enqueued Resource ID: e7d5b729-5f86-44d2-a22c-f626da244b29 with Priority: HIGHEST for action port [ 680.235819] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d5b729-5f86-44d2-a22c-f626da244b29 with Priority: HIGHEST for action port [ 680.237076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d5b729-5f86-44d2-a22c-f626da244b29 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.237076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d5b729-5f86-44d2-a22c-f626da244b29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.237076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d5b729-5f86-44d2-a22c-f626da244b29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.237076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d5b729-5f86-44d2-a22c-f626da244b29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.237076] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d5b729-5f86-44d2-a22c-f626da244b29',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.363540] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0622f2ee-a32a-4cbc-ac0b-33dc3141be7e [ 680.363540] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.363540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.363540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.363540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.363824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.363824] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0622f2ee-a32a-4cbc-ac0b-33dc3141be7e already deleted. [ 680.363824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0622f2ee-a32a-4cbc-ac0b-33dc3141be7e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.742641] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d5b729-5f86-44d2-a22c-f626da244b29 [ 680.743816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.744981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.745102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.745350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.746970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.747152] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d5b729-5f86-44d2-a22c-f626da244b29 already deleted. [ 680.747273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d5b729-5f86-44d2-a22c-f626da244b29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.658471] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d29bd3a0-8d97-4bdc-b1f5-38ff88f94557 None None] Enqueued Resource ID: eb008165-c522-421b-9f65-43379376438c with Priority: HIGHEST for action port [ 681.658471] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb008165-c522-421b-9f65-43379376438c with Priority: HIGHEST for action port [ 681.659102] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb008165-c522-421b-9f65-43379376438c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.659190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb008165-c522-421b-9f65-43379376438c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.659225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb008165-c522-421b-9f65-43379376438c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.659587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb008165-c522-421b-9f65-43379376438c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.659587] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb008165-c522-421b-9f65-43379376438c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.828127] env[69847]: INFO networking_nsxv3.common.synchronization [None req-bf1e1c10-dd73-4424-b55a-4277aba87fec None None] Enqueued Resource ID: af782186-dd30-4e19-b079-4c8a89bbc43a with Priority: HIGHEST for action port [ 681.828127] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af782186-dd30-4e19-b079-4c8a89bbc43a with Priority: HIGHEST for action port [ 681.828526] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-af782186-dd30-4e19-b079-4c8a89bbc43a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.828526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af782186-dd30-4e19-b079-4c8a89bbc43a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.828526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af782186-dd30-4e19-b079-4c8a89bbc43a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.828746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af782186-dd30-4e19-b079-4c8a89bbc43a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.828801] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af782186-dd30-4e19-b079-4c8a89bbc43a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.161277] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb008165-c522-421b-9f65-43379376438c [ 682.161366] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.161693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.161693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.161843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.161843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.162245] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb008165-c522-421b-9f65-43379376438c already deleted. [ 682.162245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb008165-c522-421b-9f65-43379376438c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.279632] env[69847]: INFO networking_nsxv3.common.synchronization [None req-5403747e-93ca-4799-8039-295af2c9bb0e None None] Enqueued Resource ID: e242477f-fa86-49a3-a519-eb74bea15beb with Priority: HIGHEST for action port [ 682.279898] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e242477f-fa86-49a3-a519-eb74bea15beb with Priority: HIGHEST for action port [ 682.280465] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e242477f-fa86-49a3-a519-eb74bea15beb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.280595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e242477f-fa86-49a3-a519-eb74bea15beb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.282466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e242477f-fa86-49a3-a519-eb74bea15beb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.282466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e242477f-fa86-49a3-a519-eb74bea15beb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.282466] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e242477f-fa86-49a3-a519-eb74bea15beb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.331166] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af782186-dd30-4e19-b079-4c8a89bbc43a [ 682.331698] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.332093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.332214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.332431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.332527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.332627] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af782186-dd30-4e19-b079-4c8a89bbc43a already deleted. [ 682.332711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af782186-dd30-4e19-b079-4c8a89bbc43a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.517898] env[69847]: INFO networking_nsxv3.common.synchronization [None req-1f25a11f-758a-4420-b43a-c94a53124a1d None None] Enqueued Resource ID: bd4b548d-ea62-43e6-972f-df8fb1eb7132 with Priority: HIGHEST for action port [ 682.518766] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd4b548d-ea62-43e6-972f-df8fb1eb7132 with Priority: HIGHEST for action port [ 682.520148] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd4b548d-ea62-43e6-972f-df8fb1eb7132 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.520299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd4b548d-ea62-43e6-972f-df8fb1eb7132" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.520385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd4b548d-ea62-43e6-972f-df8fb1eb7132" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.520604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd4b548d-ea62-43e6-972f-df8fb1eb7132" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.520691] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd4b548d-ea62-43e6-972f-df8fb1eb7132',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.785534] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e242477f-fa86-49a3-a519-eb74bea15beb [ 682.785534] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.785534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.785534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.785534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.785534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.785534] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e242477f-fa86-49a3-a519-eb74bea15beb already deleted. [ 682.785534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e242477f-fa86-49a3-a519-eb74bea15beb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.025471] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd4b548d-ea62-43e6-972f-df8fb1eb7132 [ 683.025471] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.025471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.025471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.025471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.025471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.025471] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd4b548d-ea62-43e6-972f-df8fb1eb7132 already deleted. [ 683.025471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd4b548d-ea62-43e6-972f-df8fb1eb7132" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.899365] env[69847]: INFO networking_nsxv3.common.synchronization [None req-38f019a8-b270-4c9e-8f8f-e1b1dd62c6cf None None] Enqueued Resource ID: 6e9451a3-0e80-42ff-bd22-198977ca0c28 with Priority: HIGHEST for action port [ 683.899627] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9451a3-0e80-42ff-bd22-198977ca0c28 with Priority: HIGHEST for action port [ 683.900225] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e9451a3-0e80-42ff-bd22-198977ca0c28 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.900353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e9451a3-0e80-42ff-bd22-198977ca0c28" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.900419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e9451a3-0e80-42ff-bd22-198977ca0c28" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.900672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e9451a3-0e80-42ff-bd22-198977ca0c28" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.901328] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e9451a3-0e80-42ff-bd22-198977ca0c28',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.155824] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9123b2a3-f23e-4b0b-8304-70204dcf6c17 None None] Enqueued Resource ID: 614762aa-5785-4f4b-a597-28d81a0a94ab with Priority: HIGHEST for action port [ 684.155824] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614762aa-5785-4f4b-a597-28d81a0a94ab with Priority: HIGHEST for action port [ 684.155824] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-614762aa-5785-4f4b-a597-28d81a0a94ab taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.155824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-614762aa-5785-4f4b-a597-28d81a0a94ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.155824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-614762aa-5785-4f4b-a597-28d81a0a94ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.155824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-614762aa-5785-4f4b-a597-28d81a0a94ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.155824] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('614762aa-5785-4f4b-a597-28d81a0a94ab',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.303239] env[69847]: INFO networking_nsxv3.common.synchronization [None req-49cc4736-cf3f-430a-b3d2-c9476a8a3e29 None None] Enqueued Resource ID: 67cfa8ee-5068-488d-a75f-5a087d6ade99 with Priority: HIGHEST for action port [ 684.303457] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67cfa8ee-5068-488d-a75f-5a087d6ade99 with Priority: HIGHEST for action port [ 684.304148] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-67cfa8ee-5068-488d-a75f-5a087d6ade99 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.304296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67cfa8ee-5068-488d-a75f-5a087d6ade99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.304362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67cfa8ee-5068-488d-a75f-5a087d6ade99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.304600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67cfa8ee-5068-488d-a75f-5a087d6ade99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.304708] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67cfa8ee-5068-488d-a75f-5a087d6ade99',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.404028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e9451a3-0e80-42ff-bd22-198977ca0c28 [ 684.404028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.404028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.404028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.404028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.404028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.404028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e9451a3-0e80-42ff-bd22-198977ca0c28 already deleted. [ 684.404028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e9451a3-0e80-42ff-bd22-198977ca0c28" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.412664] env[69847]: INFO networking_nsxv3.common.synchronization [req-f18055c2-dfcf-4a5c-91ab-7d59534c7a7a req-d9a933e5-c269-4bfe-af9b-a53fab616976 tempest-DeleteServersAdminTestJSON-2145681394 tempest-DeleteServersAdminTestJSON-2145681394-project-member] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 684.413203] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 684.413523] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.413634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.413713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.413932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.414157] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.414262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.414325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.414491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.414559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.414650] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.460862] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b8c82dc7-f906-49cb-b142-67bb4f1c642b None None] Enqueued Resource ID: df1c5a7b-c208-45c2-a97e-39046ad2ca32 with Priority: HIGHEST for action port [ 684.460862] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1c5a7b-c208-45c2-a97e-39046ad2ca32 with Priority: HIGHEST for action port [ 684.461557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-df1c5a7b-c208-45c2-a97e-39046ad2ca32 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.461650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df1c5a7b-c208-45c2-a97e-39046ad2ca32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.461686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df1c5a7b-c208-45c2-a97e-39046ad2ca32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.461932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df1c5a7b-c208-45c2-a97e-39046ad2ca32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.462239] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1c5a7b-c208-45c2-a97e-39046ad2ca32',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.661190] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 614762aa-5785-4f4b-a597-28d81a0a94ab [ 684.661396] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.661530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.661646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.661810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.661886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.661977] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:614762aa-5785-4f4b-a597-28d81a0a94ab already deleted. [ 684.662066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-614762aa-5785-4f4b-a597-28d81a0a94ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.811027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67cfa8ee-5068-488d-a75f-5a087d6ade99 [ 684.811027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.811027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.811027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.811027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.811027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.811027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67cfa8ee-5068-488d-a75f-5a087d6ade99 already deleted. [ 684.811027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67cfa8ee-5068-488d-a75f-5a087d6ade99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.917139] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.917344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.917432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.919053] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.919053] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 already deleted. [ 684.919053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.964647] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df1c5a7b-c208-45c2-a97e-39046ad2ca32 [ 684.964647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.964823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.964857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.965665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.965665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.965665] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df1c5a7b-c208-45c2-a97e-39046ad2ca32 already deleted. [ 684.965665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df1c5a7b-c208-45c2-a97e-39046ad2ca32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.308237] env[69847]: INFO networking_nsxv3.common.synchronization [req-004fa6ed-ea90-4b53-a5ef-e2c9ae5302cd req-ecce0f62-ec98-4d0b-a773-7545df3a8d65 tempest-ServersAdminNegativeTestJSON-26222337 tempest-ServersAdminNegativeTestJSON-26222337-project-member] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 685.308465] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 685.308789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.308863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.308963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.311602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.311759] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.311873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.311935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.312349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.312427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.312778] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.815848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.816047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.816795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.818372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.818372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.818372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.818372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.818372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.818541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.818622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.818712] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b already deleted. [ 685.818798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.902491] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.902710] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.902850] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.903854] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.904230] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.904442] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.904550] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.904830] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.904940] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.905327] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.905459] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.905574] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.905689] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.905818] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.905928] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.906120] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.927909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.927909] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.927909] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.927909] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.927909] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.928170] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.928232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.932747] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.932747] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f03e5775-3dd9-4755-9189-6c8fdb7d0e30',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.073456] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.073823] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.074125] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.074542] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.074971] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.075380] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.075552] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.076541] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.078339] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.078339] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.078339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.078339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.078339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.078339] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.078339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.078339] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.095208] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.095447] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.095587] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.095776] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.096751] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-53837faa-51b4-48e2-95c4-30635f431ce4 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.096751] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.096751] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.096751] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.097014] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53837faa-51b4-48e2-95c4-30635f431ce4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.173421] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9b50544e-b5d7-4e2c-acef-97ac79b3469a None None] Enqueued Resource ID: 2950ad97-4927-4d28-a60c-b0ffb0fa1448 with Priority: HIGHEST for action port [ 686.173905] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2950ad97-4927-4d28-a60c-b0ffb0fa1448 with Priority: HIGHEST for action port [ 686.174214] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2950ad97-4927-4d28-a60c-b0ffb0fa1448 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.174331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2950ad97-4927-4d28-a60c-b0ffb0fa1448" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.174398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2950ad97-4927-4d28-a60c-b0ffb0fa1448" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.174639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2950ad97-4927-4d28-a60c-b0ffb0fa1448" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.174717] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2950ad97-4927-4d28-a60c-b0ffb0fa1448',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.398774] env[69847]: INFO networking_nsxv3.common.synchronization [None req-625e1cd1-2ddf-4c66-8cd0-e5fe1ccb0a68 None None] Enqueued Resource ID: aa6793b7-3b0b-4f37-b66d-96fc9baf6e67 with Priority: HIGHEST for action port [ 686.398774] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6793b7-3b0b-4f37-b66d-96fc9baf6e67 with Priority: HIGHEST for action port [ 686.398774] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa6793b7-3b0b-4f37-b66d-96fc9baf6e67 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.399398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa6793b7-3b0b-4f37-b66d-96fc9baf6e67" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.399398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa6793b7-3b0b-4f37-b66d-96fc9baf6e67" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.399903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa6793b7-3b0b-4f37-b66d-96fc9baf6e67" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.400113] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa6793b7-3b0b-4f37-b66d-96fc9baf6e67',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.437180] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.437335] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.437487] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.437844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.438011] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.438175] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f03e5775-3dd9-4755-9189-6c8fdb7d0e30 not found, creating... [ 686.438440] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.438671] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.438865] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.439153] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.439298] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.439661] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.439902] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.440058] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.440231] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.440347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.440492] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f03e5775-3dd9-4755-9189-6c8fdb7d0e30 is going to be created. [ 686.464114] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.464114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.464114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.464283] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.468023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.468023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.601025] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.601025] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.601025] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.601025] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.601025] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.601279] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 53837faa-51b4-48e2-95c4-30635f431ce4 not found, creating... [ 686.602087] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.602087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.602087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.602087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.602087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.602438] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.602438] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.602545] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.602730] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.602860] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.602997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 53837faa-51b4-48e2-95c4-30635f431ce4 is going to be created. [ 686.629407] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.630143] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.630143] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.630143] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.630358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.630485] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.681651] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2950ad97-4927-4d28-a60c-b0ffb0fa1448 [ 686.683034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.683034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.683034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.683034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.683034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.683034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2950ad97-4927-4d28-a60c-b0ffb0fa1448 already deleted. [ 686.683034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2950ad97-4927-4d28-a60c-b0ffb0fa1448" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.901773] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa6793b7-3b0b-4f37-b66d-96fc9baf6e67 [ 686.902101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.902369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.902499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.902776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.903015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.903158] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa6793b7-3b0b-4f37-b66d-96fc9baf6e67 already deleted. [ 686.903275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa6793b7-3b0b-4f37-b66d-96fc9baf6e67" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.316177] env[69847]: INFO networking_nsxv3.common.synchronization [req-f18055c2-dfcf-4a5c-91ab-7d59534c7a7a req-39b50825-2721-47ca-8a4a-6284b01108b4 service nova] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_rules [ 687.316480] env[69847]: INFO networking_nsxv3.common.synchronization [req-f18055c2-dfcf-4a5c-91ab-7d59534c7a7a req-39b50825-2721-47ca-8a4a-6284b01108b4 service nova] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 687.316633] env[69847]: INFO networking_nsxv3.common.synchronization [req-f18055c2-dfcf-4a5c-91ab-7d59534c7a7a req-39b50825-2721-47ca-8a4a-6284b01108b4 service nova] Enqueued Resource ID: f03e5775-3dd9-4755-9189-6c8fdb7d0e30 with Priority: HIGHEST for action port [ 687.317556] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_rules [ 687.317556] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 687.317556] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f03e5775-3dd9-4755-9189-6c8fdb7d0e30 with Priority: HIGHEST for action port [ 687.318023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.318570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.318687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.319036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.319495] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.321125] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.321206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.321287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.321466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.321619] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.321713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.321775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.321931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.322728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.322728] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.323498] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.326299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.326299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.326299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.326299] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f03e5775-3dd9-4755-9189-6c8fdb7d0e30',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.783474] env[69847]: INFO networking_nsxv3.common.synchronization [req-004fa6ed-ea90-4b53-a5ef-e2c9ae5302cd req-c51023d4-2b7f-45b2-8899-43a61225bc2e service nova] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_rules [ 687.783729] env[69847]: INFO networking_nsxv3.common.synchronization [req-004fa6ed-ea90-4b53-a5ef-e2c9ae5302cd req-c51023d4-2b7f-45b2-8899-43a61225bc2e service nova] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 687.783778] env[69847]: INFO networking_nsxv3.common.synchronization [req-004fa6ed-ea90-4b53-a5ef-e2c9ae5302cd req-c51023d4-2b7f-45b2-8899-43a61225bc2e service nova] Enqueued Resource ID: 53837faa-51b4-48e2-95c4-30635f431ce4 with Priority: HIGHEST for action port [ 687.783983] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_rules [ 687.784128] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 687.784223] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53837faa-51b4-48e2-95c4-30635f431ce4 with Priority: HIGHEST for action port [ 687.784745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.784894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.784950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.785355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.785439] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.786246] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.786370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.786418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.789629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.789629] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.789629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-53837faa-51b4-48e2-95c4-30635f431ce4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.789629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.789629] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53837faa-51b4-48e2-95c4-30635f431ce4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.825769] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.825936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.840309] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f03e5775-3dd9-4755-9189-6c8fdb7d0e30 with status ACTIVE [ 687.840309] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.840521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.840521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.840708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.840763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.840948] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.841088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.841149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.841302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.841377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.841560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.841653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.841695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.841837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.841911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.841997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f03e5775-3dd9-4755-9189-6c8fdb7d0e30 is going to be updated. [ 687.844312] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.866996] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.867145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.867145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.867370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.867573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.867722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f03e5775-3dd9-4755-9189-6c8fdb7d0e30" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.293667] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.293667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.293944] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53837faa-51b4-48e2-95c4-30635f431ce4 with status ACTIVE [ 688.293944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.294085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.298292] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.298292] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.298292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.298292] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53837faa-51b4-48e2-95c4-30635f431ce4 is going to be updated. [ 688.298292] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.319301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.319851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.319851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.319851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.319851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.321030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53837faa-51b4-48e2-95c4-30635f431ce4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.347949] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.802648] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.852215] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.852215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.852215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.852215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.852215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.852215] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be created. [ 688.878716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.878866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.878937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.879179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.879340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.889495] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: UNINITIALIZED for 2s [ 689.285849] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b057495f-da8a-4f42-8472-5eab96b56152 None None] Enqueued Resource ID: e99cd8c8-1450-4cb4-b010-a3e048707660 with Priority: HIGHEST for action port [ 689.286115] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99cd8c8-1450-4cb4-b010-a3e048707660 with Priority: HIGHEST for action port [ 689.287046] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e99cd8c8-1450-4cb4-b010-a3e048707660 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.287046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e99cd8c8-1450-4cb4-b010-a3e048707660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.287046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e99cd8c8-1450-4cb4-b010-a3e048707660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.287531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e99cd8c8-1450-4cb4-b010-a3e048707660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.287605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e99cd8c8-1450-4cb4-b010-a3e048707660',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.307232] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.307232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.307232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.307232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.307232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.307232] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be created. [ 689.328626] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.328769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.328907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.329052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.329208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.337821] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: UNINITIALIZED for 2s [ 689.791414] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e99cd8c8-1450-4cb4-b010-a3e048707660 [ 689.791414] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.791414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.791414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.791682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.791840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.792801] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e99cd8c8-1450-4cb4-b010-a3e048707660 already deleted. [ 689.792911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e99cd8c8-1450-4cb4-b010-a3e048707660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.215769] env[69847]: INFO networking_nsxv3.common.synchronization [None req-2879bf07-3b03-4773-8531-16e15630d9cb None None] Enqueued Resource ID: 554185f0-760c-41aa-b3eb-7bfe8f407589 with Priority: HIGHEST for action port [ 690.216359] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 554185f0-760c-41aa-b3eb-7bfe8f407589 with Priority: HIGHEST for action port [ 690.217411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-554185f0-760c-41aa-b3eb-7bfe8f407589 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.217411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-554185f0-760c-41aa-b3eb-7bfe8f407589" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.217411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-554185f0-760c-41aa-b3eb-7bfe8f407589" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.217411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-554185f0-760c-41aa-b3eb-7bfe8f407589" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.217411] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554185f0-760c-41aa-b3eb-7bfe8f407589',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.721014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 554185f0-760c-41aa-b3eb-7bfe8f407589 [ 690.721218] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.722506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.722506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.722506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.722506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.722506] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:554185f0-760c-41aa-b3eb-7bfe8f407589 already deleted. [ 690.722506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-554185f0-760c-41aa-b3eb-7bfe8f407589" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.898223] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 690.898444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.898935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.898935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.899064] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.899135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.899178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.899328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.899406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.899487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.899591] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.350566] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.350566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.350566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.350566] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.403832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.403832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.403832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.403832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.404252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.404252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.404252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.404375] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.404375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.404443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.404663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.404663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.404753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.404818] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.854842] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.855031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.855157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.855374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.855590] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.856312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.856312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.856312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.856312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.856312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.856312] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.856691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.856691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.856691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.856952] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.856952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.856952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.857829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.857829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.857829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.857829] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.908402] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8022d569-fc48-4639-a726-38e4b078eac1: rpc.has_security_group_logging(os_id): False [ 691.927299] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.927299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.927299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.927299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.927610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.927844] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.927844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.927984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.929468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.929468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.929468] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.929468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.929468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.929468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.929468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.930123] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.930259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.930346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.930512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.930616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.930717] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be created. [ 691.987195] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.987378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.987451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.989565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.989565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.003105] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: IN_PROGRESS for 2s [ 692.052058] env[69847]: INFO networking_nsxv3.common.synchronization [req-3800944c-b1ae-41a1-bc1d-7a1f2f95b7e0 req-5acfd52d-d775-4451-a5a9-34cf0b475e62 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 692.052708] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 692.053693] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.054232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.054446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.054818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.055097] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.055181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.055297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.055528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.055655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.056149] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.369241] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1f264c4-f165-4427-b9e3-23d05179073b: rpc.has_security_group_logging(os_id): False [ 692.388338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.388338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.388338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.388338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.388773] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.392048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.392048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.392048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.392048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.392048] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be created. [ 692.447293] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.447502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.448444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.448823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.449064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.461591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 2s [ 692.560358] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.560443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.560485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.560701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.560943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.560984] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.561090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.561150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.561302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.561377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.561456] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe already deleted. [ 692.561565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.859034] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.861907] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.861907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.862340] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.862340] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.862517] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.862661] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.862810] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.862810] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.863052] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.895503] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.896749] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.897104] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.897465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.897990] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-91ce0862-d6d8-4a3c-91e7-5a21b4087541 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.898579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.898579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.899356] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.901108] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ce0862-d6d8-4a3c-91e7-5a21b4087541',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.027491] env[69847]: INFO networking_nsxv3.common.synchronization [None req-08d7a690-ba76-4006-835e-089147f3e386 None None] Enqueued Resource ID: 98bf02d4-c41a-4f86-a7f5-53f9c555a343 with Priority: HIGHEST for action port [ 693.027491] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98bf02d4-c41a-4f86-a7f5-53f9c555a343 with Priority: HIGHEST for action port [ 693.027578] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-98bf02d4-c41a-4f86-a7f5-53f9c555a343 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.027688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98bf02d4-c41a-4f86-a7f5-53f9c555a343" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.027809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98bf02d4-c41a-4f86-a7f5-53f9c555a343" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.029374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98bf02d4-c41a-4f86-a7f5-53f9c555a343" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.029499] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98bf02d4-c41a-4f86-a7f5-53f9c555a343',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.405384] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.405754] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.405898] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.406199] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.406360] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.406517] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 91ce0862-d6d8-4a3c-91e7-5a21b4087541 not found, creating... [ 693.406794] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.406956] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.407133] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.407399] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.407479] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.407727] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.409062] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.409287] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.409533] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.409675] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.409831] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 91ce0862-d6d8-4a3c-91e7-5a21b4087541 is going to be created. [ 693.432697] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.433070] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.433070] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.433287] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.433474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.433694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.532899] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98bf02d4-c41a-4f86-a7f5-53f9c555a343 [ 693.532899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.532899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.532899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.532899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.532899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.532899] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98bf02d4-c41a-4f86-a7f5-53f9c555a343 already deleted. [ 693.532899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98bf02d4-c41a-4f86-a7f5-53f9c555a343" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.588958] env[69847]: INFO networking_nsxv3.common.synchronization [None req-f8810c47-d47e-44a1-94fc-94b5ff30baa7 None None] Enqueued Resource ID: 5f26804b-3530-496b-b8b2-6348987428ca with Priority: HIGHEST for action port [ 693.589254] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f26804b-3530-496b-b8b2-6348987428ca with Priority: HIGHEST for action port [ 693.589775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f26804b-3530-496b-b8b2-6348987428ca taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.589897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f26804b-3530-496b-b8b2-6348987428ca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.589967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f26804b-3530-496b-b8b2-6348987428ca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.591824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f26804b-3530-496b-b8b2-6348987428ca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.591974] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f26804b-3530-496b-b8b2-6348987428ca',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.023380] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 694.023380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.095286] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f26804b-3530-496b-b8b2-6348987428ca [ 694.095560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.095637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.097566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.097566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.097566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.097566] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f26804b-3530-496b-b8b2-6348987428ca already deleted. [ 694.097566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f26804b-3530-496b-b8b2-6348987428ca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.125949] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4234f0a4-18f3-4819-8c9d-730bb4e95ae4 None None] Enqueued Resource ID: 9e319fa9-c1b4-4554-ae76-e4623c1a254f with Priority: HIGHEST for action port [ 694.127013] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e319fa9-c1b4-4554-ae76-e4623c1a254f with Priority: HIGHEST for action port [ 694.127013] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e319fa9-c1b4-4554-ae76-e4623c1a254f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.127190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e319fa9-c1b4-4554-ae76-e4623c1a254f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.127711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e319fa9-c1b4-4554-ae76-e4623c1a254f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.127711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e319fa9-c1b4-4554-ae76-e4623c1a254f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.127711] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e319fa9-c1b4-4554-ae76-e4623c1a254f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.475666] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 694.475666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.537868] env[69847]: INFO networking_nsxv3.common.synchronization [req-3800944c-b1ae-41a1-bc1d-7a1f2f95b7e0 req-4f16c9c9-aa9a-4c0d-95b7-712fc85fdd0b service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 694.538059] env[69847]: INFO networking_nsxv3.common.synchronization [req-3800944c-b1ae-41a1-bc1d-7a1f2f95b7e0 req-4f16c9c9-aa9a-4c0d-95b7-712fc85fdd0b service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 694.538204] env[69847]: INFO networking_nsxv3.common.synchronization [req-3800944c-b1ae-41a1-bc1d-7a1f2f95b7e0 req-4f16c9c9-aa9a-4c0d-95b7-712fc85fdd0b service nova] Enqueued Resource ID: 91ce0862-d6d8-4a3c-91e7-5a21b4087541 with Priority: HIGHEST for action port [ 694.538428] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 694.538567] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 694.538663] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ce0862-d6d8-4a3c-91e7-5a21b4087541 with Priority: HIGHEST for action port [ 694.539785] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.539927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.540023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.540283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.540513] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.541368] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.541485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.541550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.541719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.541866] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.541958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.542034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.542176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.542267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.542371] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.543082] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ce0862-d6d8-4a3c-91e7-5a21b4087541 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.543188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.543251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.543405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.543475] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ce0862-d6d8-4a3c-91e7-5a21b4087541',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.634181] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e319fa9-c1b4-4554-ae76-e4623c1a254f [ 694.634424] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.634562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.634626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.634841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.634934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.635045] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e319fa9-c1b4-4554-ae76-e4623c1a254f already deleted. [ 694.635126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e319fa9-c1b4-4554-ae76-e4623c1a254f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.765681] env[69847]: INFO networking_nsxv3.common.synchronization [req-23b34992-aea5-4a51-a1f2-71c51732eaa8 req-13c71e39-58d8-4384-b1c5-9b973b351a2c tempest-ServerAddressesTestJSON-525856355 tempest-ServerAddressesTestJSON-525856355-project-member] Enqueued Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_members [ 694.765681] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_members [ 694.765940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.766073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.766140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766545] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.766647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.766845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.766845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.766942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.767038] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.048433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.048433] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.048433] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91ce0862-d6d8-4a3c-91e7-5a21b4087541 with status ACTIVE [ 695.048433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.048433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.048433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.049398] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.049398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.049398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.049398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.049398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.049398] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91ce0862-d6d8-4a3c-91e7-5a21b4087541 is going to be updated. [ 695.073142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.073347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.073401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.073606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.073778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.074025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ce0862-d6d8-4a3c-91e7-5a21b4087541" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.269469] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.269683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.269786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.270068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.270207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.270435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.273848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.273848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.273848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.273848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.273848] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b already deleted. [ 695.273848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.551381] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.053738] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.053913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.053974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.054215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.054312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.054433] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be created. [ 696.075417] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.075546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.075589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.075898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.075989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.084386] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: UNINITIALIZED for 2s [ 696.135015] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.135352] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.135352] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.135754] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.135904] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.136068] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.136564] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.136564] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.136564] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.136776] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.136829] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.136932] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.139086] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.139292] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.139393] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.141892] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.161409] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.161562] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.165021] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.165021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.165021] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.165021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.165021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.165021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.165021] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae24f7b-15fe-41ff-84b5-e01ae6d9410c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.364780] env[69847]: INFO networking_nsxv3.common.synchronization [None req-93315e5c-9fea-4431-b220-a8801e99c51b tempest-VolumesAssistedSnapshotsTest-805081964 tempest-VolumesAssistedSnapshotsTest-805081964-project-member] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_rules [ 696.365398] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_rules [ 696.365729] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.365729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.365870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.367365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.368781] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.540344] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c9968967-0e64-4a21-a403-c47f8e3bdeeb tempest-VolumesAssistedSnapshotsTest-805081964 tempest-VolumesAssistedSnapshotsTest-805081964-project-member] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_rules [ 696.540344] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_rules [ 696.540344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.540693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.668159] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.668516] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.668643] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.669239] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.669501] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.669851] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port dae24f7b-15fe-41ff-84b5-e01ae6d9410c not found, creating... [ 696.670303] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.670557] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.670728] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.671102] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.671271] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.671661] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.672255] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.672633] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.672963] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.673172] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.673396] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: dae24f7b-15fe-41ff-84b5-e01ae6d9410c is going to be created. [ 696.693905] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.694209] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.694343] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.694804] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.695049] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.695330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.889164] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.890154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.890389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.890714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.891201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.891466] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c already deleted. [ 696.891805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.892160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.892567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.892790] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.909126] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ea5228-fddf-40db-b174-e5d4b85368df req-b6a76d4f-423e-4baa-9e0a-408c51a22b60 tempest-FloatingIPsAssociationTestJSON-943086566 tempest-FloatingIPsAssociationTestJSON-943086566-project-member] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 696.909126] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 696.909126] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.909126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.910352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.911158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.911548] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.913897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.913897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.913897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.913897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.913897] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.163269] env[69847]: INFO networking_nsxv3.common.synchronization [None req-3f8b2d6d-9355-4213-aada-116c8ad3f698 None None] Enqueued Resource ID: 62015a67-d319-402a-95d1-6b25a85c1dd7 with Priority: HIGHEST for action port [ 697.164028] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62015a67-d319-402a-95d1-6b25a85c1dd7 with Priority: HIGHEST for action port [ 697.164364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-62015a67-d319-402a-95d1-6b25a85c1dd7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.164522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62015a67-d319-402a-95d1-6b25a85c1dd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.164675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62015a67-d319-402a-95d1-6b25a85c1dd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.164971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62015a67-d319-402a-95d1-6b25a85c1dd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.165157] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62015a67-d319-402a-95d1-6b25a85c1dd7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.289129] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ab70f15d-4c61-46af-b2a3-6ae40139bdd2 None None] Enqueued Resource ID: 55884996-f87f-4b05-abc5-491e54e8c587 with Priority: HIGHEST for action port [ 697.289129] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55884996-f87f-4b05-abc5-491e54e8c587 with Priority: HIGHEST for action port [ 697.289209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-55884996-f87f-4b05-abc5-491e54e8c587 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.289267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55884996-f87f-4b05-abc5-491e54e8c587" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.289332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55884996-f87f-4b05-abc5-491e54e8c587" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.294081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55884996-f87f-4b05-abc5-491e54e8c587" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.294081] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55884996-f87f-4b05-abc5-491e54e8c587',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.412105] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.412298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.412378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.412601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.412705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.412835] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c already deleted. [ 697.412867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.414389] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.414510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.414778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.414847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.414975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.415101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.415207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.415273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.415430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.415512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.415597] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 already deleted. [ 697.415683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.670110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62015a67-d319-402a-95d1-6b25a85c1dd7 [ 697.670110] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.670110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.670110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.670110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.670110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.670110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62015a67-d319-402a-95d1-6b25a85c1dd7 already deleted. [ 697.670110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62015a67-d319-402a-95d1-6b25a85c1dd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.793295] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55884996-f87f-4b05-abc5-491e54e8c587 [ 697.793798] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.793798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.793798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.794603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.794603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.794603] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55884996-f87f-4b05-abc5-491e54e8c587 already deleted. [ 697.794603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55884996-f87f-4b05-abc5-491e54e8c587" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.094488] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.094682] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.094800] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.095135] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.095380] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.095533] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.095651] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.095863] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.095999] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.097245] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.097374] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.097488] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.097600] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.097718] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.097824] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.099240] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.104036] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 698.104036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.104356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.104558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.104706] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.104815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.104883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.105129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.105232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.105359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.105403] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.132468] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.133600] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.133804] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.133993] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.134462] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-1304e67a-01c1-4597-8e2c-7c2b82179e25 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.135032] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.135032] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.135215] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.135365] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1304e67a-01c1-4597-8e2c-7c2b82179e25',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.610082] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.610082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.610082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.610082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.610082] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.610447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.610447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.610447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.610447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.610559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.610719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.610775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.610806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.614915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.614915] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.614915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.614915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.614915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.614915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.614915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.614915] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.614915] env[69847]: INFO networking_nsxv3.common.synchronization [req-23b34992-aea5-4a51-a1f2-71c51732eaa8 req-973becd0-6e77-4a47-9b9f-14386ed5be0f service nova] Enqueued Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_rules [ 698.614915] env[69847]: INFO networking_nsxv3.common.synchronization [req-23b34992-aea5-4a51-a1f2-71c51732eaa8 req-973becd0-6e77-4a47-9b9f-14386ed5be0f service nova] Enqueued Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_members [ 698.614915] env[69847]: INFO networking_nsxv3.common.synchronization [req-23b34992-aea5-4a51-a1f2-71c51732eaa8 req-973becd0-6e77-4a47-9b9f-14386ed5be0f service nova] Enqueued Resource ID: dae24f7b-15fe-41ff-84b5-e01ae6d9410c with Priority: HIGHEST for action port [ 698.614915] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_rules [ 698.614915] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_members [ 698.614915] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae24f7b-15fe-41ff-84b5-e01ae6d9410c with Priority: HIGHEST for action port [ 698.615770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.615770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.615770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.616098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.616098] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.617029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.617029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.617029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.617378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.617378] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.617378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.617782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.617782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.617782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.617782] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.618975] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.618975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.618975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.619271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.619271] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae24f7b-15fe-41ff-84b5-e01ae6d9410c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.639023] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.639023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.639023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.639442] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.639442] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.639442] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 1304e67a-01c1-4597-8e2c-7c2b82179e25 not found, creating... [ 698.639655] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.639819] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.639976] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.640302] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.640471] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.640810] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.641033] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.641517] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.641762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.641904] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.642074] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 1304e67a-01c1-4597-8e2c-7c2b82179e25 is going to be created. [ 698.662716] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.662918] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.663648] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.664215] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.664306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.664491] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.115037] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b495386a-9f65-4bd6-a72b-2cc4c5b333fe: rpc.has_security_group_logging(os_id): False [ 699.120592] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.124330] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.124330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.124470] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dae24f7b-15fe-41ff-84b5-e01ae6d9410c with status ACTIVE [ 699.124507] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.124624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.124715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.124955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.125127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.125875] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.125875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.125875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.125875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.126088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.126492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.126492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.126492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.126621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.126621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.126728] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dae24f7b-15fe-41ff-84b5-e01ae6d9410c is going to be updated. [ 699.136200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.136200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.136200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.136200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.137732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.139745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.139745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.139745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.139745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.139745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.140547] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be created. [ 699.148713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.148713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.148713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.148713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.148713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.148713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae24f7b-15fe-41ff-84b5-e01ae6d9410c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.164292] env[69847]: INFO networking_nsxv3.common.synchronization [None req-a0ae718d-69ea-480a-9aca-d1fdeafb4c5b None None] Enqueued Resource ID: c51425dc-2cca-44c5-a041-8668c06a9acb with Priority: HIGHEST for action port [ 699.164845] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c51425dc-2cca-44c5-a041-8668c06a9acb with Priority: HIGHEST for action port [ 699.165793] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c51425dc-2cca-44c5-a041-8668c06a9acb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.166049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c51425dc-2cca-44c5-a041-8668c06a9acb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.166161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c51425dc-2cca-44c5-a041-8668c06a9acb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.166472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c51425dc-2cca-44c5-a041-8668c06a9acb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.166701] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51425dc-2cca-44c5-a041-8668c06a9acb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.214501] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.214673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.214715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.214928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.215832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.231162] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 699.289211] env[69847]: INFO networking_nsxv3.common.synchronization [None req-0b11efe8-d8a6-407c-90d1-2e344284b145 tempest-ServersTestJSON-999074606 tempest-ServersTestJSON-999074606-project-member] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_rules [ 699.289211] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_rules [ 699.290042] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.290229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.290305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.290547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.290641] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.373871] env[69847]: INFO networking_nsxv3.common.synchronization [None req-aa4fcf3f-6968-4dbf-a55a-ebf16d1cf51d tempest-ServersTestJSON-999074606 tempest-ServersTestJSON-999074606-project-member] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_rules [ 699.373871] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_rules [ 699.373871] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.375110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.629954] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.672213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c51425dc-2cca-44c5-a041-8668c06a9acb [ 699.672213] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.672213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.672213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.672213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.672213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.672213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c51425dc-2cca-44c5-a041-8668c06a9acb already deleted. [ 699.672213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c51425dc-2cca-44c5-a041-8668c06a9acb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.819159] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.819159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.819159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.819159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.819159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.819159] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 already deleted. [ 699.819159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.819159] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d477125d-66fd-4b6d-b693-4233fc6ad2f1 None None] Enqueued Resource ID: 1aad55a4-2e16-4b2b-9b89-6a1391ab57df with Priority: HIGHEST for action port [ 699.823227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.823601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.825107] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.825313] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aad55a4-2e16-4b2b-9b89-6a1391ab57df with Priority: HIGHEST for action port [ 699.826147] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aad55a4-2e16-4b2b-9b89-6a1391ab57df taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.826497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aad55a4-2e16-4b2b-9b89-6a1391ab57df" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.832680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aad55a4-2e16-4b2b-9b89-6a1391ab57df" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.832680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aad55a4-2e16-4b2b-9b89-6a1391ab57df" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.832680] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aad55a4-2e16-4b2b-9b89-6a1391ab57df',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.127857] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ea5228-fddf-40db-b174-e5d4b85368df req-4d2d8e7e-0241-48e8-9ce0-22855c39c103 service nova] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_rules [ 700.128141] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ea5228-fddf-40db-b174-e5d4b85368df req-4d2d8e7e-0241-48e8-9ce0-22855c39c103 service nova] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 700.129063] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ea5228-fddf-40db-b174-e5d4b85368df req-4d2d8e7e-0241-48e8-9ce0-22855c39c103 service nova] Enqueued Resource ID: 1304e67a-01c1-4597-8e2c-7c2b82179e25 with Priority: HIGHEST for action port [ 700.129063] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_rules [ 700.129063] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 700.129063] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1304e67a-01c1-4597-8e2c-7c2b82179e25 with Priority: HIGHEST for action port [ 700.131362] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.131501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.131563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.133969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.133969] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.133969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.133969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.133969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.133969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.134245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.134349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.134349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.134473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.134556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.134647] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.137679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1304e67a-01c1-4597-8e2c-7c2b82179e25 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.137973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.137973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.139763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.139763] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1304e67a-01c1-4597-8e2c-7c2b82179e25',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.139763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.139763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.139763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.140410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.140410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.140410] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b is going to be created. [ 700.165644] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.167950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.167950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.167950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.167950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.176519] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b in Status: UNINITIALIZED for 2s [ 700.334052] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aad55a4-2e16-4b2b-9b89-6a1391ab57df [ 700.335290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.335366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.335448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.335778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.338638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.338779] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aad55a4-2e16-4b2b-9b89-6a1391ab57df already deleted. [ 700.338882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aad55a4-2e16-4b2b-9b89-6a1391ab57df" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.354779] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.354919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.355109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.355209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.355300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.355392] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 already deleted. [ 700.355475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.641159] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.641319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.641781] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.645336] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1304e67a-01c1-4597-8e2c-7c2b82179e25 with status ACTIVE [ 700.645336] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.645336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.645656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.646187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.646187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.646564] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.646564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.646564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.646727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.646894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.646962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.647090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.647205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.647451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.647451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.647451] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1304e67a-01c1-4597-8e2c-7c2b82179e25 is going to be updated. [ 700.670581] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.672021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.672021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.672021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.672021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.672021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1304e67a-01c1-4597-8e2c-7c2b82179e25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.150783] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.257981] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 701.258247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.516209] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8ea8273a-31e4-46bc-b237-893e5b77dcaa None None] Enqueued Resource ID: 2b7a694d-4e65-4124-b428-dba911cd766b with Priority: HIGHEST for action port [ 701.516729] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b7a694d-4e65-4124-b428-dba911cd766b with Priority: HIGHEST for action port [ 701.517436] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b7a694d-4e65-4124-b428-dba911cd766b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.517864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b7a694d-4e65-4124-b428-dba911cd766b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.517991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b7a694d-4e65-4124-b428-dba911cd766b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.519308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b7a694d-4e65-4124-b428-dba911cd766b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.519308] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b7a694d-4e65-4124-b428-dba911cd766b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.657052] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.657572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.658046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.658532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.659657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.659657] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be created. [ 701.683441] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.685528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.685528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.685528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.685528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.693746] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: UNINITIALIZED for 2s [ 702.021759] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b7a694d-4e65-4124-b428-dba911cd766b [ 702.021759] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.021759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.021759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.021759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.021759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.021759] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b7a694d-4e65-4124-b428-dba911cd766b already deleted. [ 702.021759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b7a694d-4e65-4124-b428-dba911cd766b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.188995] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b in Status: SUCCESS [ 702.189277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.189394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.189604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.189790] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.189902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.189963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.190224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.190304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.190391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.190480] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.696272] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.696436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.696523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.696766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.696964] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.697089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.697153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.697338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.697428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.697522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.697669] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.697766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.697823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.697989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.698149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.698501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.698574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.699410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.699544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.699664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.699765] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.205030] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9adcb44b-15db-439a-8e0e-af687bcfa50b: rpc.has_security_group_logging(os_id): False [ 703.233034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.233034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.233034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.233253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.233253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.233583] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.233583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.233583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.233721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.233793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.234137] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.234137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.234217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.239277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.239277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.239277] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.239277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.239277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.239277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.239277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.239277] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b is going to be created. [ 703.311114] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.311114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.311114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.311114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.311114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.319316] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b in Status: IN_PROGRESS for 2s [ 703.705439] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.705439] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.705439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.705439] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.871330] env[69847]: INFO networking_nsxv3.common.synchronization [req-ec8b16c9-4c08-4f65-abc1-61d3be5228f2 req-11dd8c84-ca9a-41ea-b755-e57480279a29 tempest-ListServerFiltersTestJSON-552165178 tempest-ListServerFiltersTestJSON-552165178-project-member] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 703.871857] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 703.872855] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.873194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.873532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.874191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.874623] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.875380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.875454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.875767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.877286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.877286] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.207567] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.208084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.208084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.208084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.208349] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.208349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.208515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.208580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.208644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.208856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.208986] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.208986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.209181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.209224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.209348] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.209425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.209490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.209634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.209723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.209796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.209886] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.234023] env[69847]: INFO networking_nsxv3.common.synchronization [None req-46b4a5a0-e72e-46f7-a0bd-895508fc78d1 tempest-ServersWithSpecificFlavorTestJSON-1036324866 tempest-ServersWithSpecificFlavorTestJSON-1036324866-project-member] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 704.234323] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 704.235032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.236563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.236563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.236563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.236563] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.325836] env[69847]: INFO networking_nsxv3.common.synchronization [None req-fff3bee6-3b3c-42a1-aeb2-6b7cf5e4ce7c None None] Enqueued Resource ID: 6e6614f9-8855-4646-b0da-b1ad672ce526 with Priority: HIGHEST for action port [ 704.326106] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e6614f9-8855-4646-b0da-b1ad672ce526 with Priority: HIGHEST for action port [ 704.326446] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e6614f9-8855-4646-b0da-b1ad672ce526 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.326581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e6614f9-8855-4646-b0da-b1ad672ce526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.326653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e6614f9-8855-4646-b0da-b1ad672ce526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.326923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e6614f9-8855-4646-b0da-b1ad672ce526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.327030] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e6614f9-8855-4646-b0da-b1ad672ce526',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.379409] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.379940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.379940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.379940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.379940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.380253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.380321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.381066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.381066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.381066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.381066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 already deleted. [ 704.381066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.427893] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8bdfd83f-db6c-435c-91b9-b9034246e0b5 tempest-ServersWithSpecificFlavorTestJSON-1036324866 tempest-ServersWithSpecificFlavorTestJSON-1036324866-project-member] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 704.428432] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 704.428763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.428929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.716081] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 538bdf43-fa07-48d1-906e-f7fa68a3a739: rpc.has_security_group_logging(os_id): False [ 704.734150] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.734277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.734277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.735197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.735197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.735197] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.735197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.735197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.735197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.735448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.735448] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.735522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.735552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.735688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.735758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.736015] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.736198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.736284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.736470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.736570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.736687] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be created. [ 704.760058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.760410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.760410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.760539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.761396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.761396] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c already deleted. [ 704.761396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.761396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.761396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.761594] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.796786] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.797812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.797812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.797812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.797812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.809935] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: IN_PROGRESS for 2s [ 704.829561] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e6614f9-8855-4646-b0da-b1ad672ce526 [ 704.831174] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.831174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.831174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.831174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.831416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.831416] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e6614f9-8855-4646-b0da-b1ad672ce526 already deleted. [ 704.831478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e6614f9-8855-4646-b0da-b1ad672ce526" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.912239] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8062bfd2-f1c2-4c64-8e1e-02db334f3f62 None None] Enqueued Resource ID: f1a92b69-8f6a-4758-89d1-d847f1e6b3c8 with Priority: HIGHEST for action port [ 704.912239] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a92b69-8f6a-4758-89d1-d847f1e6b3c8 with Priority: HIGHEST for action port [ 704.912482] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1a92b69-8f6a-4758-89d1-d847f1e6b3c8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.912621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1a92b69-8f6a-4758-89d1-d847f1e6b3c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.912676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1a92b69-8f6a-4758-89d1-d847f1e6b3c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.912915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1a92b69-8f6a-4758-89d1-d847f1e6b3c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.912991] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a92b69-8f6a-4758-89d1-d847f1e6b3c8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.025213] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.025213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.025420] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.025706] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.025989] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.026190] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.026329] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.026584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.026846] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.027021] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.027399] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.027563] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.027724] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.027854] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.028086] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.028210] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.045637] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.047174] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.047380] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.047784] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.048958] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-21f62a33-07c8-4a8d-88ca-d21956eacd03 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.048958] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.048958] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.048958] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.048958] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21f62a33-07c8-4a8d-88ca-d21956eacd03',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.285332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.285332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.285332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.285332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.285898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.285898] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c already deleted. [ 705.285898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.329040] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b in Status: SUCCESS [ 705.329040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.418251] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1a92b69-8f6a-4758-89d1-d847f1e6b3c8 [ 705.418251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.418251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.418251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.418251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.418251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.418251] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1a92b69-8f6a-4758-89d1-d847f1e6b3c8 already deleted. [ 705.418251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1a92b69-8f6a-4758-89d1-d847f1e6b3c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.554016] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.554016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.554016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.554016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.554016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.554016] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 21f62a33-07c8-4a8d-88ca-d21956eacd03 not found, creating... [ 705.554016] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.554016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.554016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.554581] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.554581] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.555448] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.555448] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.555448] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.555448] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.555720] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.555720] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 21f62a33-07c8-4a8d-88ca-d21956eacd03 is going to be created. [ 705.580867] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.581765] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.585225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.585225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.585225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.585225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.097168] env[69847]: INFO networking_nsxv3.common.synchronization [req-2702a6d4-e6bc-4a02-94a3-3a8f529f75f7 req-e4b95540-6ccf-4415-b513-35b7f649e326 tempest-InstanceActionsV221TestJSON-1014864041 tempest-InstanceActionsV221TestJSON-1014864041-project-member] Enqueued Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_members [ 706.097722] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_members [ 706.098042] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.098259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.098324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.098572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.098748] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.099098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.099098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.099098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.099225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.099254] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.602678] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.603025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.603025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.603262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.603358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.603576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.603673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.603733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.603881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.603995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.604039] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 already deleted. [ 706.604118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.757048] env[69847]: INFO networking_nsxv3.common.synchronization [req-ec8b16c9-4c08-4f65-abc1-61d3be5228f2 req-5179373e-fef7-4b0e-8cd4-2a2c7fbc800e service nova] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_rules [ 706.757290] env[69847]: INFO networking_nsxv3.common.synchronization [req-ec8b16c9-4c08-4f65-abc1-61d3be5228f2 req-5179373e-fef7-4b0e-8cd4-2a2c7fbc800e service nova] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 706.757353] env[69847]: INFO networking_nsxv3.common.synchronization [req-ec8b16c9-4c08-4f65-abc1-61d3be5228f2 req-5179373e-fef7-4b0e-8cd4-2a2c7fbc800e service nova] Enqueued Resource ID: 21f62a33-07c8-4a8d-88ca-d21956eacd03 with Priority: HIGHEST for action port [ 706.757575] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_rules [ 706.757695] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 706.757784] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f62a33-07c8-4a8d-88ca-d21956eacd03 with Priority: HIGHEST for action port [ 706.760258] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.760571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.760801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.761408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.763610] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.763610] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.763610] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.763610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.763610] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.769146] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-21f62a33-07c8-4a8d-88ca-d21956eacd03 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.769146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.769146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.769146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.769146] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21f62a33-07c8-4a8d-88ca-d21956eacd03',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.813257] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-212 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.813452] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-212" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.813580] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-212" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.814022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-212" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.814689] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.814815] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.814910] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.816238] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.816453] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.816832] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.816832] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.816990] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.816990] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.817113] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 706.817224] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.817341] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.831889] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 706.831889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.837836] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.837836] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 706.837836] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.838110] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-212" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.838227] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-94441ab0-302d-4615-a1de-97776c72081d taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.838398] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.838514] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.838907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.839122] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94441ab0-302d-4615-a1de-97776c72081d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.269150] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.271302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.271302] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.271663] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21f62a33-07c8-4a8d-88ca-d21956eacd03 with status ACTIVE [ 707.271810] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.271930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.271996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.276024] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.276024] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.276024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.276024] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21f62a33-07c8-4a8d-88ca-d21956eacd03 is going to be updated. [ 707.295586] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.296245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.296245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.296245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.296245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.297519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21f62a33-07c8-4a8d-88ca-d21956eacd03" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.341779] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.342029] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.342166] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.342527] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.342694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.342849] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 94441ab0-302d-4615-a1de-97776c72081d not found, creating... [ 707.343124] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.343289] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.343404] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.343628] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.343764] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.344056] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.344621] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.344621] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.344621] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.344766] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.344799] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 94441ab0-302d-4615-a1de-97776c72081d is going to be created. [ 707.369330] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.369330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.369330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.369576] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.369733] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.369957] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.522920] env[69847]: INFO networking_nsxv3.common.synchronization [None req-64e1dca4-8f52-43e8-a09e-1e6404b4c52b None None] Enqueued Resource ID: 2953e217-49b1-41c9-b0f5-33ebbcbe63c8 with Priority: HIGHEST for action port [ 707.523204] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2953e217-49b1-41c9-b0f5-33ebbcbe63c8 with Priority: HIGHEST for action port [ 707.523764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2953e217-49b1-41c9-b0f5-33ebbcbe63c8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.523893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2953e217-49b1-41c9-b0f5-33ebbcbe63c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.523962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2953e217-49b1-41c9-b0f5-33ebbcbe63c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.527413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2953e217-49b1-41c9-b0f5-33ebbcbe63c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.529194] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2953e217-49b1-41c9-b0f5-33ebbcbe63c8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.540019] env[69847]: INFO networking_nsxv3.common.synchronization [None req-092aeb15-40ec-474f-984b-28fc7c4df95a tempest-ServersTestFqdnHostnames-1597567196 tempest-ServersTestFqdnHostnames-1597567196-project-member] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_rules [ 707.540019] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_rules [ 707.540019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.540019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.540019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.540019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.540019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.546336] env[69847]: INFO networking_nsxv3.common.synchronization [None req-a380984a-bb9d-4766-9938-3cc7b19efa04 None None] Enqueued Resource ID: 2e0fe745-1402-4707-a7ea-b8c60152d215 with Priority: HIGHEST for action port [ 707.546336] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0fe745-1402-4707-a7ea-b8c60152d215 with Priority: HIGHEST for action port [ 707.546336] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0fe745-1402-4707-a7ea-b8c60152d215 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.546336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0fe745-1402-4707-a7ea-b8c60152d215" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.546336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0fe745-1402-4707-a7ea-b8c60152d215" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.546336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0fe745-1402-4707-a7ea-b8c60152d215" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.546336] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0fe745-1402-4707-a7ea-b8c60152d215',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.734720] env[69847]: INFO networking_nsxv3.common.synchronization [None req-2fa23915-b446-48a9-930e-024cc8664eac tempest-ServersTestFqdnHostnames-1597567196 tempest-ServersTestFqdnHostnames-1597567196-project-member] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_rules [ 707.735367] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_rules [ 707.736665] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.736665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.777961] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.035942] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2953e217-49b1-41c9-b0f5-33ebbcbe63c8 [ 708.036207] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.036348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.036417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.036633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.036724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.036817] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2953e217-49b1-41c9-b0f5-33ebbcbe63c8 already deleted. [ 708.036898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2953e217-49b1-41c9-b0f5-33ebbcbe63c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.048070] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e0fe745-1402-4707-a7ea-b8c60152d215 [ 708.048364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.048475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.048475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.048677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.048742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.048839] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e0fe745-1402-4707-a7ea-b8c60152d215 already deleted. [ 708.048921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0fe745-1402-4707-a7ea-b8c60152d215" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.060279] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.061184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.061184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.061548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.061548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.061627] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 already deleted. [ 708.061784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.062246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.062466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.062582] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.281556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.282378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.282378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.282378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.282378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.282378] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be created. [ 708.305040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.305040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.305040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.305209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.305285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.314450] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: UNINITIALIZED for 2s [ 708.533211] env[69847]: INFO networking_nsxv3.common.synchronization [req-f943a46d-dc3a-436b-8cca-88687457d64a req-5e24820a-1a48-42d5-af26-7629c2dd15c1 tempest-DeleteServersAdminTestJSON-1370190303 tempest-DeleteServersAdminTestJSON-1370190303-project-admin] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 708.534124] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 708.534654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.534767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.534810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.535013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.535170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.535276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.535339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.535497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.535585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.535720] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.582439] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.582611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.582684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.582904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.582998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.583106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 already deleted. [ 708.583193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.586715] env[69847]: INFO networking_nsxv3.common.synchronization [req-473f88f8-541a-4e00-8477-cfb452f9cec7 req-58500e83-fb9a-41ed-abbb-7cda63442ecd tempest-ServerExternalEventsTest-1820526223 tempest-ServerExternalEventsTest-1820526223-project-member] Enqueued Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_members [ 708.587757] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_members [ 708.589486] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.589612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.589681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.590312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.590631] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.590763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.590838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.591013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.591264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.591264] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.946175] env[69847]: INFO networking_nsxv3.common.synchronization [req-2702a6d4-e6bc-4a02-94a3-3a8f529f75f7 req-3f45142f-54b3-484b-a025-f51c68e94a06 service nova] Enqueued Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_rules [ 708.946517] env[69847]: INFO networking_nsxv3.common.synchronization [req-2702a6d4-e6bc-4a02-94a3-3a8f529f75f7 req-3f45142f-54b3-484b-a025-f51c68e94a06 service nova] Enqueued Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_members [ 708.946517] env[69847]: INFO networking_nsxv3.common.synchronization [req-2702a6d4-e6bc-4a02-94a3-3a8f529f75f7 req-3f45142f-54b3-484b-a025-f51c68e94a06 service nova] Enqueued Resource ID: 94441ab0-302d-4615-a1de-97776c72081d with Priority: HIGHEST for action port [ 708.947109] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_rules [ 708.947258] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_members [ 708.947370] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94441ab0-302d-4615-a1de-97776c72081d with Priority: HIGHEST for action port [ 708.947672] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.947805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.947906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.950452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.950563] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.951822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.951822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.951822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.952124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.952371] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.952507] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.952627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.952728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.952852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.952946] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.954184] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-94441ab0-302d-4615-a1de-97776c72081d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.954184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.954920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.955170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.955261] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94441ab0-302d-4615-a1de-97776c72081d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.038536] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.038536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.038536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.038858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.038858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.038987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.039115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.039115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.039237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.039297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.039362] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be updated. [ 709.061239] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.064021] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.064021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.064021] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.064631] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.064798] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.065039] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.065267] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.066726] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.066726] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.070945] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.070945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.070945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.070945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.070945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.078646] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: IN_PROGRESS for 2s [ 709.089855] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.089855] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.089855] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.089855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.089855] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-389fda7a-840a-4f1f-b00a-9a72df333e84 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.089855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.089855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.090762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.091141] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389fda7a-840a-4f1f-b00a-9a72df333e84',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.094179] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.094931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.094931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.094931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.095625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.095825] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.096017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.096096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.096297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.096419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.096534] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f046260-8d14-4c53-95c0-038d4be520e2 already deleted. [ 709.096636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.232978] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4086e2bf-9007-497f-9ddb-dad7a8566f10 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_rules [ 709.233596] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_rules [ 709.233919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.234722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.234828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.235179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.235686] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.416178] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6c338b19-fa38-4b91-9f43-7bea80e0b925 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_rules [ 709.416686] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_rules [ 709.416990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.417110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.460578] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.462085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.462085] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.465987] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94441ab0-302d-4615-a1de-97776c72081d with status ACTIVE [ 709.465987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.465987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.465987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.465987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.465987] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94441ab0-302d-4615-a1de-97776c72081d is going to be updated. [ 709.483115] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.483274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.483346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.483542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.483712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.483816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94441ab0-302d-4615-a1de-97776c72081d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.594297] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.594519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.594645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.594970] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.595127] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.595289] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 389fda7a-840a-4f1f-b00a-9a72df333e84 not found, creating... [ 709.595545] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.595704] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.595820] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.596051] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.596191] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.596465] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.596634] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.596828] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.596952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.597123] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.597291] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 389fda7a-840a-4f1f-b00a-9a72df333e84 is going to be created. [ 709.619342] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.619342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.619342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.619342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.619342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.619342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.767639] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.767797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.767868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.768324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.768428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.768525] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 already deleted. [ 709.768610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.768774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.768930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.768999] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.964503] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.003365] env[69847]: INFO networking_nsxv3.common.synchronization [None req-fba1ecd9-4959-441e-914d-67aae7e7d5ca None None] Enqueued Resource ID: 03a7ae85-b966-4146-8a9c-200ecc76130a with Priority: HIGHEST for action port [ 710.003660] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03a7ae85-b966-4146-8a9c-200ecc76130a with Priority: HIGHEST for action port [ 710.004230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-03a7ae85-b966-4146-8a9c-200ecc76130a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.004369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03a7ae85-b966-4146-8a9c-200ecc76130a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.004448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03a7ae85-b966-4146-8a9c-200ecc76130a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.004726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03a7ae85-b966-4146-8a9c-200ecc76130a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.004987] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03a7ae85-b966-4146-8a9c-200ecc76130a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.290681] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.290955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.291083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.291504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.291765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.291899] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 already deleted. [ 710.292011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.323121] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 710.323353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.323506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.323719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.323905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.324032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.324141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.324253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.324337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.324420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.324513] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.471440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.471440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.471440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.471440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.471440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.471440] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 is going to be created. [ 710.494017] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.494017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.494017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.494017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.494017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.501411] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 in Status: UNINITIALIZED for 2s [ 710.507822] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03a7ae85-b966-4146-8a9c-200ecc76130a [ 710.508049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.508183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.508254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.508474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.508563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.508659] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03a7ae85-b966-4146-8a9c-200ecc76130a already deleted. [ 710.508740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03a7ae85-b966-4146-8a9c-200ecc76130a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.826843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.826843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.826843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.827233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.827233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.827233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.827408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.827408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.827505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.827555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.828344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.828344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.828344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.828344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.828344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.828344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.828344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.828927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.828927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.828927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.828927] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.079173] env[69847]: INFO networking_nsxv3.common.synchronization [req-473f88f8-541a-4e00-8477-cfb452f9cec7 req-e58df805-1a3c-47fe-b564-01f3a8a93fe0 service nova] Enqueued Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_rules [ 711.079449] env[69847]: INFO networking_nsxv3.common.synchronization [req-473f88f8-541a-4e00-8477-cfb452f9cec7 req-e58df805-1a3c-47fe-b564-01f3a8a93fe0 service nova] Enqueued Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_members [ 711.079590] env[69847]: INFO networking_nsxv3.common.synchronization [req-473f88f8-541a-4e00-8477-cfb452f9cec7 req-e58df805-1a3c-47fe-b564-01f3a8a93fe0 service nova] Enqueued Resource ID: 389fda7a-840a-4f1f-b00a-9a72df333e84 with Priority: HIGHEST for action port [ 711.081194] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_rules [ 711.081319] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_members [ 711.081369] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 389fda7a-840a-4f1f-b00a-9a72df333e84 with Priority: HIGHEST for action port [ 711.081625] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.081748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.081813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.083119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.083266] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.084337] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.084883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.084996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.085362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.085437] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.085557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.085791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.085974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.086110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.086259] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.087103] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-389fda7a-840a-4f1f-b00a-9a72df333e84 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.088325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.088427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.088631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.088848] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389fda7a-840a-4f1f-b00a-9a72df333e84',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.101963] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 711.102178] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 deletion is rescheduled due to dependency. [ 711.102516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.302630] env[69847]: INFO networking_nsxv3.common.synchronization [req-ae14d9d4-b67d-4207-87d7-65b4d483f909 req-2ffb1ae0-6f41-4e0a-8a8b-10f4739c8620 tempest-ListServerFiltersTestJSON-552165178 tempest-ListServerFiltersTestJSON-552165178-project-member] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 711.302880] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 711.303931] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.303931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.303931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.303931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.303931] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.304147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.304147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.304208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.304648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.304648] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.332874] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd9acc22-8a8b-484a-8e94-b168c183d5d8: rpc.has_security_group_logging(os_id): False [ 711.367325] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.367325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.367948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.367948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.367948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.368162] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.368337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.368453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.369200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.369341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.369577] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.369717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.369810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.370042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.370315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.370687] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.370871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.370981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.371311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.371729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.371931] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be created. [ 711.432070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.432310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.432310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.432585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.432722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.443946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 711.591723] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.591925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.592083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.592302] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 389fda7a-840a-4f1f-b00a-9a72df333e84 with status ACTIVE [ 711.592523] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.592666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.592754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.593181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.593365] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.593766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.593766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.593766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.593956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.598904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.599062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.599132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.599338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.599443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.599565] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 389fda7a-840a-4f1f-b00a-9a72df333e84 is going to be updated. [ 711.620248] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.620465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.620465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.620640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.623112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.623112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-389fda7a-840a-4f1f-b00a-9a72df333e84" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.808471] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.102262] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.272202] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.272391] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.272514] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.272797] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.273077] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.273246] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.273380] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.273687] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.273841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.275643] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.278109] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.278287] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.279134] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.279134] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.279134] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.279134] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.301649] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.301812] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 712.301980] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.302145] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.302454] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.302645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.302764] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.303083] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.303218] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab0fe12c-eda7-4997-b7a3-a86d4a70262c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.310177] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.513409] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 in Status: SUCCESS [ 712.513828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.513916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.514142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.514304] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.514752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.514752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.514752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.514752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.514929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.514929] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.605367] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.605598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.605598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.605824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.605895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.605991] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f046260-8d14-4c53-95c0-038d4be520e2 is going to be created. [ 712.639161] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.639444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.639444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.639595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.639754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.651884] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f046260-8d14-4c53-95c0-038d4be520e2 in Status: UNINITIALIZED for 2s [ 712.784029] env[69847]: INFO networking_nsxv3.common.synchronization [None req-18cd14b4-de86-4e3a-82fa-56234fe60358 None None] Enqueued Resource ID: 6e503ff8-2858-485d-9586-27b6683cd2b6 with Priority: HIGHEST for action port [ 712.784029] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e503ff8-2858-485d-9586-27b6683cd2b6 with Priority: HIGHEST for action port [ 712.784029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e503ff8-2858-485d-9586-27b6683cd2b6 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.784029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e503ff8-2858-485d-9586-27b6683cd2b6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.784029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e503ff8-2858-485d-9586-27b6683cd2b6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.784029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e503ff8-2858-485d-9586-27b6683cd2b6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.784029] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e503ff8-2858-485d-9586-27b6683cd2b6',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.806377] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.806508] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.806625] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.806893] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.807171] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.807241] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ab0fe12c-eda7-4997-b7a3-a86d4a70262c not found, creating... [ 712.807472] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.807741] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.807741] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.808247] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.808247] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.808592] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.808824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.808925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.812523] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.812611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.813042] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ab0fe12c-eda7-4997-b7a3-a86d4a70262c is going to be created. [ 712.814279] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.814417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.814481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.815106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.815106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.815106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 712.838373] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.839136] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.839136] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.839136] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.839394] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.839483] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.848784] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.848913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.848913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.849074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.849219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.859070] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b7b28776-857c-48fc-b417-f83fe1110bd7 None None] Enqueued Resource ID: c1e0e105-ce7f-413e-a19a-9a82fb1184a8 with Priority: HIGHEST for action port [ 712.860899] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 712.861615] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e0e105-ce7f-413e-a19a-9a82fb1184a8 with Priority: HIGHEST for action port [ 712.861868] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1e0e105-ce7f-413e-a19a-9a82fb1184a8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.862363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1e0e105-ce7f-413e-a19a-9a82fb1184a8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.862363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1e0e105-ce7f-413e-a19a-9a82fb1184a8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.863562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1e0e105-ce7f-413e-a19a-9a82fb1184a8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.863562] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1e0e105-ce7f-413e-a19a-9a82fb1184a8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.018564] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.018564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.018771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.019037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.019079] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.019147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.019271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.019382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.019471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.019558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.019786] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.019880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.019880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.020038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.020195] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.020339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.020339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.020474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.020565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.020650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.020865] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.269843] env[69847]: INFO networking_nsxv3.common.synchronization [req-6f19cd49-baa5-4fa5-9040-3925778f5412 req-4e29dd9a-9b40-4151-99ec-730a14789a42 tempest-ServerDiagnosticsNegativeTest-1034616358 tempest-ServerDiagnosticsNegativeTest-1034616358-project-member] Enqueued Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_members [ 713.270415] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_members [ 713.270713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.270831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.270916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.271335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.271490] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.271717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.271717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.271845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.271895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.272840] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.290741] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e503ff8-2858-485d-9586-27b6683cd2b6 [ 713.290977] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.291135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.291225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.291449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.291549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.291645] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e503ff8-2858-485d-9586-27b6683cd2b6 already deleted. [ 713.291726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e503ff8-2858-485d-9586-27b6683cd2b6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.365841] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1e0e105-ce7f-413e-a19a-9a82fb1184a8 [ 713.366048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.366432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.366959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.366959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.367312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.367688] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1e0e105-ce7f-413e-a19a-9a82fb1184a8 already deleted. [ 713.367688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1e0e105-ce7f-413e-a19a-9a82fb1184a8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.459254] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 713.459519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.524058] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b2d82cb-7e65-491f-8df0-d52a50997ba5: rpc.has_security_group_logging(os_id): False [ 713.547022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.547022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.547022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.547178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.547212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.548395] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.548395] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.548395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.548825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.548825] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.548825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.548825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.548959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.548959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.549597] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 is going to be created. [ 713.607402] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.607550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.607970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.607970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.608125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.622201] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 in Status: IN_PROGRESS for 2s [ 713.650248] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.650458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.650606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.650842] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.651164] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.651281] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.651515] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.651579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.651728] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.651932] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.654994] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.654994] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.654994] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.654994] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.654994] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.654994] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.703124] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.703387] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.703665] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.704500] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.704500] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-d65e0f94-6341-443c-b202-a659ea64dfdc taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.704500] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.704828] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.705061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.705247] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65e0f94-6341-443c-b202-a659ea64dfdc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.776156] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.776308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.776378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.776596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.776721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.776882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.777105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.777105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.777209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.777265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.777345] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598796a3-3295-47ec-afb1-170cde7401b5 already deleted. [ 713.777430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.143928] env[69847]: INFO networking_nsxv3.common.synchronization [req-ae14d9d4-b67d-4207-87d7-65b4d483f909 req-6e440140-2dba-4a1f-bd6f-e09634863911 service nova] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_rules [ 714.144123] env[69847]: INFO networking_nsxv3.common.synchronization [req-ae14d9d4-b67d-4207-87d7-65b4d483f909 req-6e440140-2dba-4a1f-bd6f-e09634863911 service nova] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 714.144263] env[69847]: INFO networking_nsxv3.common.synchronization [req-ae14d9d4-b67d-4207-87d7-65b4d483f909 req-6e440140-2dba-4a1f-bd6f-e09634863911 service nova] Enqueued Resource ID: ab0fe12c-eda7-4997-b7a3-a86d4a70262c with Priority: HIGHEST for action port [ 714.144485] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_rules [ 714.144610] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 714.144706] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab0fe12c-eda7-4997-b7a3-a86d4a70262c with Priority: HIGHEST for action port [ 714.145259] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.145385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.145451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.145643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.145722] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.150498] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.150630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.151055] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.151198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.151261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.151427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.151501] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab0fe12c-eda7-4997-b7a3-a86d4a70262c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.208944] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.208944] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.208944] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.209282] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.209584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.209934] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port d65e0f94-6341-443c-b202-a659ea64dfdc not found, creating... [ 714.210322] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.210556] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.210714] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.210999] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.211330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.211950] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.211950] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.212100] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.212359] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.212559] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.212932] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: d65e0f94-6341-443c-b202-a659ea64dfdc is going to be created. [ 714.245354] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.245524] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.245648] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.245924] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.246166] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.246992] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.654701] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.655039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.655039] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab0fe12c-eda7-4997-b7a3-a86d4a70262c with status ACTIVE [ 714.658022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.658022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.658022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.658022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.658022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab0fe12c-eda7-4997-b7a3-a86d4a70262c is going to be updated. [ 714.676019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f046260-8d14-4c53-95c0-038d4be520e2 in Status: SUCCESS [ 714.676237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.676402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.676602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.676781] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.676891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.676951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.677121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.677209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.677290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.677375] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.681956] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.682101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.682169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.682343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.682466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.682631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab0fe12c-eda7-4997-b7a3-a86d4a70262c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.871841] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 714.872270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.872415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.872737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.873026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.873160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.873328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.873521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.873657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.873809] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.034258] env[69847]: INFO networking_nsxv3.common.synchronization [req-6f19cd49-baa5-4fa5-9040-3925778f5412 req-bccb4096-5bef-44e6-98b2-1dfa334417d7 service nova] Enqueued Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_rules [ 715.034258] env[69847]: INFO networking_nsxv3.common.synchronization [req-6f19cd49-baa5-4fa5-9040-3925778f5412 req-bccb4096-5bef-44e6-98b2-1dfa334417d7 service nova] Enqueued Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_members [ 715.034258] env[69847]: INFO networking_nsxv3.common.synchronization [req-6f19cd49-baa5-4fa5-9040-3925778f5412 req-bccb4096-5bef-44e6-98b2-1dfa334417d7 service nova] Enqueued Resource ID: d65e0f94-6341-443c-b202-a659ea64dfdc with Priority: HIGHEST for action port [ 715.034258] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_rules [ 715.034258] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_members [ 715.034258] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d65e0f94-6341-443c-b202-a659ea64dfdc with Priority: HIGHEST for action port [ 715.034846] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.034846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.034962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.035219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.035437] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.040101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.040257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.040323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.040531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.040686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.040778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.040837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.040973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.041095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.041250] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.042138] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d65e0f94-6341-443c-b202-a659ea64dfdc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.042263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.042541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.042541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.042541] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d65e0f94-6341-443c-b202-a659ea64dfdc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.141549] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6dcaa26b-5830-4b0b-a527-aaffc03fa3f1 None None] Enqueued Resource ID: 81b87037-f125-4847-933a-0060fc12fb99 with Priority: HIGHEST for action port [ 715.141549] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b87037-f125-4847-933a-0060fc12fb99 with Priority: HIGHEST for action port [ 715.142099] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-81b87037-f125-4847-933a-0060fc12fb99 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.142344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81b87037-f125-4847-933a-0060fc12fb99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.142344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81b87037-f125-4847-933a-0060fc12fb99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.142567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81b87037-f125-4847-933a-0060fc12fb99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.142686] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81b87037-f125-4847-933a-0060fc12fb99',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.181230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.181230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.181230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.181723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.181723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.181723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.182036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.182036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.182183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.182183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.182857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.182857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.182857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.182857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.182857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.182857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.183202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.183202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.183202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.183202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.183356] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.381388] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.544563] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.544694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.544880] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.545797] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d65e0f94-6341-443c-b202-a659ea64dfdc with status ACTIVE [ 715.545982] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.546114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.546183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.546392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.546513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.549046] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.549046] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.549046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.549046] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d65e0f94-6341-443c-b202-a659ea64dfdc is going to be updated. [ 715.572073] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.572239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.572313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.572554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.572704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.572879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d65e0f94-6341-443c-b202-a659ea64dfdc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.647082] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 in Status: SUCCESS [ 715.647334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.647590] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81b87037-f125-4847-933a-0060fc12fb99 [ 715.647789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.647991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.647991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.648192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.648276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.648362] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81b87037-f125-4847-933a-0060fc12fb99 already deleted. [ 715.648441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81b87037-f125-4847-933a-0060fc12fb99" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.686629] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f046260-8d14-4c53-95c0-038d4be520e2: rpc.has_security_group_logging(os_id): False [ 715.712444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.713069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.713069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.713069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.713069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.713269] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.713354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.713415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.713570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.713669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.714028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.714028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.714134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.714200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.714382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.715062] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.715062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.715062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.715062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.715062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.715062] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f046260-8d14-4c53-95c0-038d4be520e2 is going to be created. [ 715.786387] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ec3a3c9-1ad6-49db-9986-5281ccd5d929 req-c664d95f-ba63-49e4-a830-a5c3910c4079 tempest-ListServerFiltersTestJSON-552165178 tempest-ListServerFiltersTestJSON-552165178-project-member] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 715.786963] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 715.787379] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.787480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.805104] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.805284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.805331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.805662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.805730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.824168] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f046260-8d14-4c53-95c0-038d4be520e2 in Status: IN_PROGRESS for 2s [ 715.885033] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.050856] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.390351] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.390928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.391023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.392865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.392865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.392865] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 716.423444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.423444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.423444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.423698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.423926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.435302] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 716.555199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.555362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.555433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.555655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.555747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.555876] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598796a3-3295-47ec-afb1-170cde7401b5 is going to be created. [ 716.579440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.579673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.579799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.581097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.581097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.593295] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598796a3-3295-47ec-afb1-170cde7401b5 in Status: UNINITIALIZED for 2s [ 716.668223] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.668223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.668223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.668223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.668223] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.668223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.668223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.668223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.669057] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.669730] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.669967] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.670770] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.670852] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.670991] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.671512] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.671512] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.690570] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.690977] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.690977] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.691104] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-965" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.691647] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.691647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.691647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.691983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.692134] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.197963] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.198197] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.198353] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.198821] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.200020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.200020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 not found, creating... [ 717.200020] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.200020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.200020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.200554] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.200554] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.200891] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.205268] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.205436] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.205743] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.207760] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.207760] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 is going to be created. [ 717.232455] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.232738] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.236068] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.236068] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.236068] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.236068] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.465744] env[69847]: INFO networking_nsxv3.common.synchronization [req-3acb4482-c588-4c8a-a610-24577da8b9df req-fb25c7e3-f6b1-4897-b4b3-30d1ebd1ce74 tempest-ServerAddressesTestJSON-525856355 tempest-ServerAddressesTestJSON-525856355-project-member] Enqueued Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_members [ 717.465744] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGHEST for action security_group_members [ 717.465744] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.465744] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.465744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.465744] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.845040] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f046260-8d14-4c53-95c0-038d4be520e2 in Status: SUCCESS [ 717.845394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.964321] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e98db38f-962c-4b8e-85bf-70c5cb9b7b12 None None] Enqueued Resource ID: 573987ad-8655-486c-83d9-966a6811798e with Priority: HIGHEST for action port [ 717.965157] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573987ad-8655-486c-83d9-966a6811798e with Priority: HIGHEST for action port [ 717.965763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-573987ad-8655-486c-83d9-966a6811798e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.966016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573987ad-8655-486c-83d9-966a6811798e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.966174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573987ad-8655-486c-83d9-966a6811798e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.966498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573987ad-8655-486c-83d9-966a6811798e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.966700] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573987ad-8655-486c-83d9-966a6811798e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.973556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.973556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.973556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.973556] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b is going to be updated. [ 718.002019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.002019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.002019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.002019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.002019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.028540] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b in Status: IN_PROGRESS for 2s [ 718.447032] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 718.447214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.448550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.448550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.448550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.448718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.448806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.449027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.449124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.449331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.449331] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.453797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.454119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.454396] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.454633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.454778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.455035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.455234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.455417] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.469481] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 573987ad-8655-486c-83d9-966a6811798e [ 718.469481] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.469755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.469755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.470041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.470155] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.470314] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:573987ad-8655-486c-83d9-966a6811798e already deleted. [ 718.470407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573987ad-8655-486c-83d9-966a6811798e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.579897] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f5bb71-256c-47ae-88de-f0b88e260ac0 req-322144af-0102-4669-98e0-2243f3e285e8 tempest-VolumesAssistedSnapshotsTest-805081964 tempest-VolumesAssistedSnapshotsTest-805081964-project-member] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_members [ 718.580716] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_members [ 718.581582] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ec3a3c9-1ad6-49db-9986-5281ccd5d929 req-4d7a0d68-500f-41b6-99f1-b5335e2a38fb service nova] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_rules [ 718.581949] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ec3a3c9-1ad6-49db-9986-5281ccd5d929 req-4d7a0d68-500f-41b6-99f1-b5335e2a38fb service nova] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 718.581949] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ec3a3c9-1ad6-49db-9986-5281ccd5d929 req-4d7a0d68-500f-41b6-99f1-b5335e2a38fb service nova] Enqueued Resource ID: 5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 with Priority: HIGHEST for action port [ 718.584019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.584019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.584019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.584019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.584732] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_rules [ 718.584850] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 718.584918] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 with Priority: HIGHEST for action port [ 718.586075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.586271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.586583] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.586662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.586786] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.586896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.586933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.587230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.587230] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.606826] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598796a3-3295-47ec-afb1-170cde7401b5 in Status: SUCCESS [ 718.606826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.606826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.606826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.606826] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.606826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.606826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.608907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.608907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.608907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.608907] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.954595] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.954595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.958199] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.088384] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.088384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.088384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.088384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.088384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.088384] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.088384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.088384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.089061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.089061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c already deleted. [ 719.089061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 with status ACTIVE [ 719.089326] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.089326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.089326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.089426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.089542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.089737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.089797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.089935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.090737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.091775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.091775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.091775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.091775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.091775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.091775] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9 is going to be updated. [ 719.111251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.111376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.111779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.111779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.111885] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.111938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.111970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.112126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.112201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.112925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.112925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.112925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.112925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.112925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.114362] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.115145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.115145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.115145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.115145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.115145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.115145] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.122912] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.123293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.123425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.123932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.123932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.125377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c3f5edc-3d81-478c-a7cc-2f4d7c6a13b9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.157828] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-696 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.158032] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-696" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.158156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-696" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.158522] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-696" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.158814] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.159053] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.159116] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.159584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.159584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.159749] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.159862] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.159996] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.160176] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.160289] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.160568] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.160568] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.195803] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.196052] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.196196] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.196381] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-696" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.196706] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.196881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.197010] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.197368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.197512] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc1b8a94-44aa-466a-a8b4-8d37a9e71640',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.463370] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.617872] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 598796a3-3295-47ec-afb1-170cde7401b5: rpc.has_security_group_logging(os_id): False [ 719.637175] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.637310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.637735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.637735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.637735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.637936] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.638029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.638150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.638276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.638357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.638573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.638672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.639073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.639073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.639073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.639168] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.639227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.639261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.642948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.642948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.642948] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 598796a3-3295-47ec-afb1-170cde7401b5 is going to be created. [ 719.701374] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.701496] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.701565] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.701868] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.702012] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.702173] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port bc1b8a94-44aa-466a-a8b4-8d37a9e71640 not found, creating... [ 719.702487] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.702919] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.702919] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.703041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.703131] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.703999] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.703999] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.703999] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.703999] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.704335] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.704641] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: bc1b8a94-44aa-466a-a8b4-8d37a9e71640 is going to be created. [ 719.718492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.718670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.718719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.719049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.719173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.733275] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 598796a3-3295-47ec-afb1-170cde7401b5 in Status: IN_PROGRESS for 2s [ 719.735053] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.735288] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.735443] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.735768] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.736045] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.736362] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.966200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.966572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.966572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.966721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.966765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.966871] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 720.011188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.011188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.011188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.011188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.011188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.021618] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 720.041134] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b in Status: SUCCESS [ 720.041134] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b deletion is rescheduled due to dependency. [ 720.041134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.389763] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7649b9bf-ec11-4311-94f6-05cc268fffab None None] Enqueued Resource ID: e2370545-f7fe-44b6-a106-7416f51123c1 with Priority: HIGHEST for action port [ 720.390023] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2370545-f7fe-44b6-a106-7416f51123c1 with Priority: HIGHEST for action port [ 720.390600] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2370545-f7fe-44b6-a106-7416f51123c1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.390717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2370545-f7fe-44b6-a106-7416f51123c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.390776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2370545-f7fe-44b6-a106-7416f51123c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.394130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2370545-f7fe-44b6-a106-7416f51123c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.394258] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2370545-f7fe-44b6-a106-7416f51123c1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.485233] env[69847]: INFO networking_nsxv3.common.synchronization [None req-17d40741-a461-4548-9ec2-e6b75c756e47 None None] Enqueued Resource ID: 8fb1215c-337a-459c-9f07-325c261a8bb3 with Priority: HIGHEST for action port [ 720.485233] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb1215c-337a-459c-9f07-325c261a8bb3 with Priority: HIGHEST for action port [ 720.485233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fb1215c-337a-459c-9f07-325c261a8bb3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.485233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fb1215c-337a-459c-9f07-325c261a8bb3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.485233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fb1215c-337a-459c-9f07-325c261a8bb3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.485233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fb1215c-337a-459c-9f07-325c261a8bb3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.485233] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fb1215c-337a-459c-9f07-325c261a8bb3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.898483] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2370545-f7fe-44b6-a106-7416f51123c1 [ 720.898839] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.899083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.899083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.899511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.899511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.899585] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2370545-f7fe-44b6-a106-7416f51123c1 already deleted. [ 720.899676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2370545-f7fe-44b6-a106-7416f51123c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.990129] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fb1215c-337a-459c-9f07-325c261a8bb3 [ 720.990129] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.990129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.990129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.990129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.990682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.990682] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fb1215c-337a-459c-9f07-325c261a8bb3 already deleted. [ 720.990682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fb1215c-337a-459c-9f07-325c261a8bb3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.208213] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f5bb71-256c-47ae-88de-f0b88e260ac0 req-12d66560-d066-4ad2-a73f-28cd1d727384 service nova] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_rules [ 721.208213] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f5bb71-256c-47ae-88de-f0b88e260ac0 req-12d66560-d066-4ad2-a73f-28cd1d727384 service nova] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_members [ 721.208213] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f5bb71-256c-47ae-88de-f0b88e260ac0 req-12d66560-d066-4ad2-a73f-28cd1d727384 service nova] Enqueued Resource ID: bc1b8a94-44aa-466a-a8b4-8d37a9e71640 with Priority: HIGHEST for action port [ 721.208476] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_rules [ 721.208602] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_members [ 721.208698] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b8a94-44aa-466a-a8b4-8d37a9e71640 with Priority: HIGHEST for action port [ 721.209298] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.209433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.209512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.209767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.209859] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.210824] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.210933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.210997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.211665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.211817] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.211915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.211975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.212142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.212246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.212365] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.213149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.213255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.213318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.213467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.213536] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc1b8a94-44aa-466a-a8b4-8d37a9e71640',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.718311] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.718311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.718538] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.719489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc1b8a94-44aa-466a-a8b4-8d37a9e71640 with status ACTIVE [ 721.719668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.719795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.719852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.720088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.720177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.720391] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.720517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.720574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.720679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.720752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.728524] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.728524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.728524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.728524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.728524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.728524] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc1b8a94-44aa-466a-a8b4-8d37a9e71640 is going to be updated. [ 721.746740] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 598796a3-3295-47ec-afb1-170cde7401b5 in Status: SUCCESS [ 721.746953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.752975] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.753687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.753687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.756896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.756896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.756896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc1b8a94-44aa-466a-a8b4-8d37a9e71640" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.761710] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-63abec3c-4df0-40c9-be62-3d7767a0a1c2 tempest-ListServersNegativeTestJSON-366547923 tempest-ListServersNegativeTestJSON-366547923-project-member] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 721.762273] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 721.762739] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.762859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.762931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.763180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.763533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.763533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.763916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.763916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.763916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.763916] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.034107] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 722.034482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.034723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.036738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.036738] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.036738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.036738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.036738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.036738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.036738] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.228647] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.268621] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.268621] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.268621] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f already deleted. [ 722.268621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.393204] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7af0b1e1-5dee-4df8-a6c2-d115288930ac None None] Enqueued Resource ID: 49619d54-4d17-40d1-bf07-738a68f3fd97 with Priority: HIGHEST for action port [ 722.397079] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49619d54-4d17-40d1-bf07-738a68f3fd97 with Priority: HIGHEST for action port [ 722.397079] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-49619d54-4d17-40d1-bf07-738a68f3fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.397079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49619d54-4d17-40d1-bf07-738a68f3fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.397079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49619d54-4d17-40d1-bf07-738a68f3fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.397703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49619d54-4d17-40d1-bf07-738a68f3fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.397828] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49619d54-4d17-40d1-bf07-738a68f3fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.539635] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.734042] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.734294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.734396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.734676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.734802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.734952] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c is going to be created. [ 722.764654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.764834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.764834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.765437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.765437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.777782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: UNINITIALIZED for 2s [ 722.824121] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.824320] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.824437] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.824780] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.825058] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.825229] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.825368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.825602] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.825747] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.826058] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.826953] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.827110] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.827222] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.827339] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.827444] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.827575] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.849859] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.849859] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.849859] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.850090] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.851676] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-7f113aff-b163-40a6-912e-b2100c7043ef taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.851676] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.851676] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.852431] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.852431] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f113aff-b163-40a6-912e-b2100c7043ef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.901623] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49619d54-4d17-40d1-bf07-738a68f3fd97 [ 722.901768] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.902422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.902422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.902422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.902422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.902422] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49619d54-4d17-40d1-bf07-738a68f3fd97 already deleted. [ 722.902611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49619d54-4d17-40d1-bf07-738a68f3fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.043564] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.355379] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.355379] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.355379] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.359027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 7f113aff-b163-40a6-912e-b2100c7043ef not found, creating... [ 723.359027] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.359027] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.359027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.359942] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.359942] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.359942] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.359942] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 7f113aff-b163-40a6-912e-b2100c7043ef is going to be created. [ 723.364859] env[69847]: INFO networking_nsxv3.common.synchronization [None req-27638888-36d6-426c-8402-e5a75918dfaa None None] Enqueued Resource ID: 4405ff0b-928e-4f8a-b01b-695c6ce50a32 with Priority: HIGHEST for action port [ 723.365233] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4405ff0b-928e-4f8a-b01b-695c6ce50a32 with Priority: HIGHEST for action port [ 723.365806] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4405ff0b-928e-4f8a-b01b-695c6ce50a32 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.365943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4405ff0b-928e-4f8a-b01b-695c6ce50a32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.367556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4405ff0b-928e-4f8a-b01b-695c6ce50a32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.367947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4405ff0b-928e-4f8a-b01b-695c6ce50a32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.368225] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4405ff0b-928e-4f8a-b01b-695c6ce50a32',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.380984] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.381284] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.381748] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.382101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.382458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.382712] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.547893] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.547893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.547893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.547893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.547893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.547893] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 723.598199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.598199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.598199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.598199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.598199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.605845] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 723.873628] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4405ff0b-928e-4f8a-b01b-695c6ce50a32 [ 723.873628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.873628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.873628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.873628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.873628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.873628] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4405ff0b-928e-4f8a-b01b-695c6ce50a32 already deleted. [ 723.873628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4405ff0b-928e-4f8a-b01b-695c6ce50a32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.559181] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-a97a52f0-e994-44b2-8cf9-499b223eef43 tempest-ListServersNegativeTestJSON-366547923 tempest-ListServersNegativeTestJSON-366547923-project-member] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 724.560590] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 724.560974] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.561094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.561149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.561333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.561489] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.561623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.561751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.561848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.561915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.562128] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.788183] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: SUCCESS [ 724.788544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.788835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.789024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.789228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.789356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.789420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.789585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.789670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.789755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.790031] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.849490] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-6ae5e86b-7077-4e81-b67c-c1d3210e5e2f service nova] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_rules [ 724.850130] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-6ae5e86b-7077-4e81-b67c-c1d3210e5e2f service nova] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 724.850130] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-6ae5e86b-7077-4e81-b67c-c1d3210e5e2f service nova] Enqueued Resource ID: 7f113aff-b163-40a6-912e-b2100c7043ef with Priority: HIGHEST for action port [ 724.850362] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_rules [ 724.850716] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 724.850716] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f113aff-b163-40a6-912e-b2100c7043ef with Priority: HIGHEST for action port [ 724.851648] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.851648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.851648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.851850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.851925] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.852821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.855843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.855843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f113aff-b163-40a6-912e-b2100c7043ef taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.855843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.855843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.855843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.855843] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f113aff-b163-40a6-912e-b2100c7043ef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.065929] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.294013] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.356369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.356988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.356988] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f113aff-b163-40a6-912e-b2100c7043ef with status ACTIVE [ 725.356988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.357192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.357192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.357353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.357673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.357673] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.357847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.357847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.358318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.358417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.358592] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.358689] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.358749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.358896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.358977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.359073] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f113aff-b163-40a6-912e-b2100c7043ef is going to be updated. [ 725.367909] env[69847]: INFO networking_nsxv3.common.synchronization [req-b300d8bd-0add-4d8a-99bb-5dddf78b01de req-86b8246a-eeb3-46b5-b47b-961f13b66e62 tempest-InstanceActionsV221TestJSON-1014864041 tempest-InstanceActionsV221TestJSON-1014864041-project-member] Enqueued Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_members [ 725.368179] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 with Priority: HIGHEST for action security_group_members [ 725.368743] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b2d82cb-7e65-491f-8df0-d52a50997ba5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.368864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.368933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.369135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.369288] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.369388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.369452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.369592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.369676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.370030] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b2d82cb-7e65-491f-8df0-d52a50997ba5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.379205] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.379399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.379399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.379591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.379716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.380255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f113aff-b163-40a6-912e-b2100c7043ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.547565] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.547971] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.547971] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.548202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.548534] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.548662] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.549198] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.549435] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.549806] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.549806] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.549900] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.550112] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.550178] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.550392] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.550392] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.550596] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.562125] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d5689a0e-a361-4513-8f60-2b56fe84ff81 tempest-VolumesAdminNegativeTest-613767114 tempest-VolumesAdminNegativeTest-613767114-project-member] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_rules [ 725.563770] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_rules [ 725.563770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.563770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.563770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.566565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.566565] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.569746] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.577201] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.577201] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.577201] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.577201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.577201] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.577201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.577201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.577201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.577689] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68077ed3-573c-4db0-92a6-2bf8a2da5ccf',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.623047] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 725.623047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.623047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.623047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.623047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.623257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.623257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.624187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.624187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.624187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.624187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.624187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.624187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.624499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.624499] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.624574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.624806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.624806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.624937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.624980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.625772] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.693754] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ba8ac227-6a77-412a-8374-826a66b62918 None None] Enqueued Resource ID: 459a76f8-0c0e-48ca-9659-0db456ab8999 with Priority: HIGHEST for action port [ 725.694648] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 459a76f8-0c0e-48ca-9659-0db456ab8999 with Priority: HIGHEST for action port [ 725.695764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-459a76f8-0c0e-48ca-9659-0db456ab8999 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.695958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-459a76f8-0c0e-48ca-9659-0db456ab8999" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.696670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-459a76f8-0c0e-48ca-9659-0db456ab8999" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.696670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-459a76f8-0c0e-48ca-9659-0db456ab8999" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.696670] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('459a76f8-0c0e-48ca-9659-0db456ab8999',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.797661] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def2b8bf-1a3c-42a9-ba24-20811016588c: rpc.has_security_group_logging(os_id): False [ 725.816850] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.817009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.817088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.817307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.817401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.817636] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.817736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.817799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.818122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.818122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.818213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c is going to be created. [ 725.873897] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.873897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.873897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.873897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.873897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.874250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.874250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.874250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.874382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.874508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.874658] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 is going to be updated. [ 725.881269] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.881467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.881521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.881680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.881869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.898831] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: IN_PROGRESS for 2s [ 725.914035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.914233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.914327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.914605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.914749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.923729] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 in Status: IN_PROGRESS for 2s [ 726.065435] env[69847]: INFO networking_nsxv3.common.synchronization [None req-5234c0fe-c8ef-4e21-a9fb-c1ed0bd3c67b tempest-VolumesAdminNegativeTest-613767114 tempest-VolumesAdminNegativeTest-613767114-project-member] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_rules [ 726.069027] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_rules [ 726.069804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.069958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.074640] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.074851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.074978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.075165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.075254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.075359] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be created. [ 726.083738] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.084079] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.084258] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.084604] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.084797] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.085454] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 68077ed3-573c-4db0-92a6-2bf8a2da5ccf not found, creating... [ 726.085828] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.086108] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.089026] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.089026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.089026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 68077ed3-573c-4db0-92a6-2bf8a2da5ccf is going to be created. [ 726.101758] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.101935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.102018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.102265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.102359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.102453] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 already deleted. [ 726.102533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.102724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.103014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.103100] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.116864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.117096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.117176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.117400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.117633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.121201] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.121403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.121532] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.121850] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.122113] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.122373] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.127444] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: UNINITIALIZED for 2s [ 726.128501] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd9acc22-8a8b-484a-8e94-b168c183d5d8: rpc.has_security_group_logging(os_id): False [ 726.170206] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.170552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.170672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.171199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.171362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.171613] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.171732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.171787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.171989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.172633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.172962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.173195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.173703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.173940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.174077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.174444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.174606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.174759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.174987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.175130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.175287] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 726.203796] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 459a76f8-0c0e-48ca-9659-0db456ab8999 [ 726.203796] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.203796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.203796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.203796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.203796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.203796] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:459a76f8-0c0e-48ca-9659-0db456ab8999 already deleted. [ 726.203796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-459a76f8-0c0e-48ca-9659-0db456ab8999" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.397159] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.397307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.397378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.397606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.397766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.409942] env[69847]: INFO networking_nsxv3.common.synchronization [None req-924ac2f3-3e11-42c9-8bc1-e74f487c4b04 None None] Enqueued Resource ID: 3ee84cd9-6a80-4f0d-bd73-23539d811288 with Priority: HIGHEST for action port [ 726.409942] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee84cd9-6a80-4f0d-bd73-23539d811288 with Priority: HIGHEST for action port [ 726.409942] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ee84cd9-6a80-4f0d-bd73-23539d811288 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.410314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ee84cd9-6a80-4f0d-bd73-23539d811288" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.411140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ee84cd9-6a80-4f0d-bd73-23539d811288" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.413089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ee84cd9-6a80-4f0d-bd73-23539d811288" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.413089] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ee84cd9-6a80-4f0d-bd73-23539d811288',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.416088] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 726.631106] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.631529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.631529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.631669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.631810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.631925] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 already deleted. [ 726.632067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.913843] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ee84cd9-6a80-4f0d-bd73-23539d811288 [ 726.914442] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.914850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.915086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.915630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.915930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.916257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ee84cd9-6a80-4f0d-bd73-23539d811288 already deleted. [ 726.916515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ee84cd9-6a80-4f0d-bd73-23539d811288" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.074187] env[69847]: INFO networking_nsxv3.common.synchronization [req-851c1cc4-2899-4990-97f8-47e13948935e req-c2ac11e1-496a-47cc-b553-19ee251421b7 tempest-ServerExternalEventsTest-1820526223 tempest-ServerExternalEventsTest-1820526223-project-member] Enqueued Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_members [ 727.075881] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGHEST for action security_group_members [ 727.076177] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.076301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.076364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.076569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.076717] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.076811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.076868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.077091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.077210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.077338] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.579769] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.580047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.580135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.580433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.580584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.580924] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.581082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.581165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.581415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.581532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.581650] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f046260-8d14-4c53-95c0-038d4be520e2 is going to be updated. [ 727.617654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.617654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.617654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.617654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.617654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.626782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f046260-8d14-4c53-95c0-038d4be520e2 in Status: IN_PROGRESS for 2s [ 727.682914] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-b58f2a99-4b95-4475-bb8e-6c867568b942 tempest-ListServersNegativeTestJSON-366547923 tempest-ListServersNegativeTestJSON-366547923-project-member] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 727.683281] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 727.683627] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.683732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.913681] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: SUCCESS [ 727.914036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.943297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 in Status: SUCCESS [ 727.943501] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b2d82cb-7e65-491f-8df0-d52a50997ba5 deletion is rescheduled due to dependency. [ 727.943635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b2d82cb-7e65-491f-8df0-d52a50997ba5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.952809] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-28f977e5-bb21-47cf-8b71-9b4bde5981d2 service nova] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_rules [ 727.953177] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-28f977e5-bb21-47cf-8b71-9b4bde5981d2 service nova] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 727.953412] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-28f977e5-bb21-47cf-8b71-9b4bde5981d2 service nova] Enqueued Resource ID: 68077ed3-573c-4db0-92a6-2bf8a2da5ccf with Priority: HIGHEST for action port [ 727.954095] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_rules [ 727.954310] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 727.954453] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68077ed3-573c-4db0-92a6-2bf8a2da5ccf with Priority: HIGHEST for action port [ 727.954774] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.954874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.958034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.958034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.958034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.958034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.958034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.958034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.958034] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68077ed3-573c-4db0-92a6-2bf8a2da5ccf',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.138323] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 728.138554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.138759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.138983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.139204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.139345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.139413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.140039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.140039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.140039] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.311436] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.311436] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.311436] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.313203] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.313203] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.313203] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.313589] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.313726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.313775] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.314339] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.314339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.314339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.314339] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.314606] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.314606] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.314679] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.335481] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.335643] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.336368] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.336368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.336368] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.336574] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.336652] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.336983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.337146] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c70601-ca6c-4d8c-b6e5-aa42d590141e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.431798] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 728.432062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.432294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.433285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.433378] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.462057] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68077ed3-573c-4db0-92a6-2bf8a2da5ccf with status ACTIVE [ 728.462328] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.462466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.462587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.462762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.462843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.463059] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.463171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.463376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.463548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.463628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.463815] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.463943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.464255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.464255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.464255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.464471] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68077ed3-573c-4db0-92a6-2bf8a2da5ccf is going to be updated. [ 728.486526] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.486671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.486756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.486977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.487126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.487290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68077ed3-573c-4db0-92a6-2bf8a2da5ccf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.642851] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.843568] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.844340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.844340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.844340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.844340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.844706] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port b9c70601-ca6c-4d8c-b6e5-aa42d590141e not found, creating... [ 728.844775] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.844918] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.845047] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.845291] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.845417] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.845696] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.845851] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.845977] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.846209] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.846345] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.846977] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: b9c70601-ca6c-4d8c-b6e5-aa42d590141e is going to be created. [ 728.873415] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.873415] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.873415] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.873415] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.873415] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.873415] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.917495] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8efab1bf-642b-401d-b9ee-526abb8e4173 None None] Enqueued Resource ID: 3a537e32-b566-4d59-bbd4-da6a240386c3 with Priority: HIGHEST for action port [ 728.917495] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a537e32-b566-4d59-bbd4-da6a240386c3 with Priority: HIGHEST for action port [ 728.917495] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a537e32-b566-4d59-bbd4-da6a240386c3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.917495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a537e32-b566-4d59-bbd4-da6a240386c3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.917495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a537e32-b566-4d59-bbd4-da6a240386c3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.917835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a537e32-b566-4d59-bbd4-da6a240386c3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.917944] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a537e32-b566-4d59-bbd4-da6a240386c3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.939177] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.939262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.939571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.939769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.939963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.940100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.940214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.940489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.940685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.940770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.940838] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.028624] env[69847]: INFO networking_nsxv3.common.synchronization [None req-47024c46-8344-421d-98b4-0c9343f4d3ca None None] Enqueued Resource ID: 35925156-f693-46b8-b99b-3512047e1b26 with Priority: HIGHEST for action port [ 729.029365] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35925156-f693-46b8-b99b-3512047e1b26 with Priority: HIGHEST for action port [ 729.030189] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-35925156-f693-46b8-b99b-3512047e1b26 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.030189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35925156-f693-46b8-b99b-3512047e1b26" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.030189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35925156-f693-46b8-b99b-3512047e1b26" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.030521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35925156-f693-46b8-b99b-3512047e1b26" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.030696] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35925156-f693-46b8-b99b-3512047e1b26',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.145881] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.422095] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a537e32-b566-4d59-bbd4-da6a240386c3 [ 729.423677] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.423677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.423677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.423677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.424088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.424472] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a537e32-b566-4d59-bbd4-da6a240386c3 already deleted. [ 729.424894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a537e32-b566-4d59-bbd4-da6a240386c3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.447086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.447086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.447086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.447086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.447086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.448037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.449314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.449314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.449314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.449314] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.532345] env[69847]: INFO networking_nsxv3.common.synchronization [req-6c89299a-91fd-422e-8074-61f1d2e35c92 req-9c100528-62d5-4fec-af1d-f1f4b983011f tempest-ServerDiagnosticsNegativeTest-1034616358 tempest-ServerDiagnosticsNegativeTest-1034616358-project-member] Enqueued Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_members [ 729.542030] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35925156-f693-46b8-b99b-3512047e1b26 [ 729.542030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.542030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.542030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.542030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.542030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.542030] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35925156-f693-46b8-b99b-3512047e1b26 already deleted. [ 729.542030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35925156-f693-46b8-b99b-3512047e1b26" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.542030] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 598796a3-3295-47ec-afb1-170cde7401b5 with Priority: HIGHEST for action security_group_members [ 729.545691] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-598796a3-3295-47ec-afb1-170cde7401b5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.545923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.546050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.546352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.546600] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.546808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.546849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.550190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.550190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.550190] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('598796a3-3295-47ec-afb1-170cde7401b5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.641860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f046260-8d14-4c53-95c0-038d4be520e2 in Status: SUCCESS [ 729.642099] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f046260-8d14-4c53-95c0-038d4be520e2 deletion is rescheduled due to dependency. [ 729.642179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.650419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.651552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.651552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.651552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.651797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.652156] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 729.682673] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.682673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.682673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.682673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.682673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.699130] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 729.810218] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-0e51e2dd-984a-4357-ad03-026c3eabe53c service nova] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_rules [ 729.810218] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-0e51e2dd-984a-4357-ad03-026c3eabe53c service nova] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 729.810218] env[69847]: INFO networking_nsxv3.common.synchronization [req-21397e1a-1a1b-41f3-ae2c-84c79889ce99 req-0e51e2dd-984a-4357-ad03-026c3eabe53c service nova] Enqueued Resource ID: b9c70601-ca6c-4d8c-b6e5-aa42d590141e with Priority: HIGHEST for action port [ 729.810218] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_rules [ 729.810218] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 729.810218] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c70601-ca6c-4d8c-b6e5-aa42d590141e with Priority: HIGHEST for action port [ 729.812197] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.812346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.813496] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.813496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.813496] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.813496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.813496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.813496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.813496] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c70601-ca6c-4d8c-b6e5-aa42d590141e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.942736] env[69847]: INFO networking_nsxv3.common.synchronization [None req-abb23fc9-bc82-4c8d-915e-00a2cb1992ef None None] Enqueued Resource ID: c6f8693d-8a1b-4a97-a00e-b8832bad8091 with Priority: HIGHEST for action port [ 729.942736] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f8693d-8a1b-4a97-a00e-b8832bad8091 with Priority: HIGHEST for action port [ 729.944927] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6f8693d-8a1b-4a97-a00e-b8832bad8091 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.944927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6f8693d-8a1b-4a97-a00e-b8832bad8091" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.944927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6f8693d-8a1b-4a97-a00e-b8832bad8091" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.944927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6f8693d-8a1b-4a97-a00e-b8832bad8091" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.944927] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f8693d-8a1b-4a97-a00e-b8832bad8091',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.953050] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd9acc22-8a8b-484a-8e94-b168c183d5d8: rpc.has_security_group_logging(os_id): False [ 729.975710] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.975949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.976045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.976287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.976397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.976609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.977247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.977247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.977247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.977423] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.977423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.977526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.977968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.978073] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.978227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.978338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.978505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.978648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.978732] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 730.049035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.049208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.049208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.049424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.049549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.051368] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.051368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.051368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.051368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.052304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.052545] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.052663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.052746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.052911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.053024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.053104] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598796a3-3295-47ec-afb1-170cde7401b5 is going to be updated. [ 730.084810] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 730.112800] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.112933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.113055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.113514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.113514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.124460] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598796a3-3295-47ec-afb1-170cde7401b5 in Status: IN_PROGRESS for 2s [ 730.329194] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9c70601-ca6c-4d8c-b6e5-aa42d590141e with status ACTIVE [ 730.329194] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.329385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.329500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.329744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.329838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.331058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.331058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.331058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.331784] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9c70601-ca6c-4d8c-b6e5-aa42d590141e is going to be updated. [ 730.363169] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.363169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.363169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.363169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.363169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.363169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9c70601-ca6c-4d8c-b6e5-aa42d590141e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.452364] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6f8693d-8a1b-4a97-a00e-b8832bad8091 [ 730.452364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.452364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.452364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.452364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.452364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.452364] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6f8693d-8a1b-4a97-a00e-b8832bad8091 already deleted. [ 730.452364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6f8693d-8a1b-4a97-a00e-b8832bad8091" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.265846] env[69847]: INFO networking_nsxv3.common.synchronization [None req-32a95c6d-26c7-4a78-874a-97b9f18d5fd3 None None] Enqueued Resource ID: bb6bff2c-9fc6-48f1-bc20-1a53b80161dd with Priority: HIGHEST for action port [ 731.266127] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb6bff2c-9fc6-48f1-bc20-1a53b80161dd with Priority: HIGHEST for action port [ 731.267777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb6bff2c-9fc6-48f1-bc20-1a53b80161dd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.267777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb6bff2c-9fc6-48f1-bc20-1a53b80161dd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.267777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb6bff2c-9fc6-48f1-bc20-1a53b80161dd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.267777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb6bff2c-9fc6-48f1-bc20-1a53b80161dd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.268610] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb6bff2c-9fc6-48f1-bc20-1a53b80161dd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.709192] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 731.709419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.709583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.709798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.709985] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.710115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.710177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.710328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.710500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.710601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.710695] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.711632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.711823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.711975] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.712892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.716510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.716709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.716798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.717020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.772333] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb6bff2c-9fc6-48f1-bc20-1a53b80161dd [ 731.772333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.772333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.772333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.772333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.772333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.772333] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb6bff2c-9fc6-48f1-bc20-1a53b80161dd already deleted. [ 731.772333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb6bff2c-9fc6-48f1-bc20-1a53b80161dd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.102013] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 732.102013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.122157] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e24b7801-c751-417c-b623-98bbb971cd30 None None] Enqueued Resource ID: 1da02a31-2bf7-41e1-8804-77876f5491aa with Priority: HIGHEST for action port [ 732.122783] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1da02a31-2bf7-41e1-8804-77876f5491aa with Priority: HIGHEST for action port [ 732.127932] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1da02a31-2bf7-41e1-8804-77876f5491aa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.127932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1da02a31-2bf7-41e1-8804-77876f5491aa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.128270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1da02a31-2bf7-41e1-8804-77876f5491aa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.128628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1da02a31-2bf7-41e1-8804-77876f5491aa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.128628] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da02a31-2bf7-41e1-8804-77876f5491aa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.143360] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 598796a3-3295-47ec-afb1-170cde7401b5 in Status: SUCCESS [ 732.143969] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 598796a3-3295-47ec-afb1-170cde7401b5 deletion is rescheduled due to dependency. [ 732.143969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-598796a3-3295-47ec-afb1-170cde7401b5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.219636] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.219636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.221008] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.632256] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1da02a31-2bf7-41e1-8804-77876f5491aa [ 732.633023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.633634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.633787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.634143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.634502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.634689] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1da02a31-2bf7-41e1-8804-77876f5491aa already deleted. [ 732.634951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1da02a31-2bf7-41e1-8804-77876f5491aa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.724938] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.231846] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.232084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.232164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.232505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.233386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.233386] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 733.265940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.268662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.268850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.268965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.269201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.285870] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 735.298728] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.298728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.298728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.298728] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.807380] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.965443] env[69847]: INFO networking_nsxv3.common.synchronization [req-d5d8db46-df54-4552-a046-c5a6fc1ab5b7 req-a4503b56-03f4-47ab-8a3e-62df0a63817f tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 735.965443] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 735.965443] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.965443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.965443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.965443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.969170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.969170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.969170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.969170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.969170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.969170] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.051676] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a1c1a10-f5f8-439f-b885-e5a74a8a8944 req-c85aca59-176a-4c86-8be2-29a3979e745f tempest-ServersTestJSON-999074606 tempest-ServersTestJSON-999074606-project-member] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_members [ 736.052508] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_members [ 736.053460] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.053652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.053773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.054043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.054251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.054367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.054436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.054843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.054843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.054989] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.312139] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.479508] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.479508] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.479508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.479508] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 736.516352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.516544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.516591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.516853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.516988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.530508] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 736.558972] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.559288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.559382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.559565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.559671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.559896] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.560028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.560096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.560262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.560445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.560445] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 already deleted. [ 736.560544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.566661] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-819 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.566849] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-819" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.566968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-819" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.567313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-819" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.568945] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.569053] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.569130] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.571225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.571225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.571225] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.571225] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.571225] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.571225] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.571225] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.571225] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.571225] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.591205] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.591311] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.591399] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.591610] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-819" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.592770] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-efc01834-5126-4829-91d2-791c7f927276 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.592988] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.593189] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.593750] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.593934] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc01834-5126-4829-91d2-791c7f927276',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.813562] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.813747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.813814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.813994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.814107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.814218] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 736.845960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.846490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.846490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.846490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.846639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.856371] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 737.096643] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.096888] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.097029] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.097335] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.097493] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.097632] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port efc01834-5126-4829-91d2-791c7f927276 not found, creating... [ 737.097907] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.098080] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.098188] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.098423] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.098583] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.098867] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.099230] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.099352] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.099707] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.099707] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.099841] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: efc01834-5126-4829-91d2-791c7f927276 is going to be created. [ 737.121291] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.121564] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.121816] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.121974] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.122226] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.123327] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.854429] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a1c1a10-f5f8-439f-b885-e5a74a8a8944 req-9ba44202-10a1-4569-81d7-de2d1e67e116 service nova] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_rules [ 737.854809] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a1c1a10-f5f8-439f-b885-e5a74a8a8944 req-9ba44202-10a1-4569-81d7-de2d1e67e116 service nova] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_members [ 737.854809] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a1c1a10-f5f8-439f-b885-e5a74a8a8944 req-9ba44202-10a1-4569-81d7-de2d1e67e116 service nova] Enqueued Resource ID: efc01834-5126-4829-91d2-791c7f927276 with Priority: HIGHEST for action port [ 737.854809] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_rules [ 737.855022] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_members [ 737.855094] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc01834-5126-4829-91d2-791c7f927276 with Priority: HIGHEST for action port [ 737.855597] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.855774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.855872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.856390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.856487] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.858547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.858720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.858778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.858946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.859128] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.859491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.859491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.859589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.859645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.859736] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.864574] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-efc01834-5126-4829-91d2-791c7f927276 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.864574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.864730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.864934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.865072] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc01834-5126-4829-91d2-791c7f927276',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.085537] env[69847]: INFO networking_nsxv3.common.synchronization [req-c9389266-dc01-4b2d-9714-70ac609b5f26 req-7bd84842-83ec-4964-9651-17e9d3489b28 tempest-ServerMetadataNegativeTestJSON-1309640846 tempest-ServerMetadataNegativeTestJSON-1309640846-project-member] Enqueued Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_members [ 738.087076] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_members [ 738.087076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.087076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.087076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.087076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.087076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.087076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.087076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.087679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.087679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.088194] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.367570] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.367570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.367570] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.368307] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efc01834-5126-4829-91d2-791c7f927276 with status ACTIVE [ 738.368521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.368647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.368896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.368896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.369046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.369939] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.369939] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.369939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.371185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.371319] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efc01834-5126-4829-91d2-791c7f927276 is going to be updated. [ 738.396694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.396844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.396913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.397250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.397393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.397556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efc01834-5126-4829-91d2-791c7f927276" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.540919] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 738.541268] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe deletion is rescheduled due to dependency. [ 738.541268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.593599] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.593863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.593950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.594240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.594360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.594587] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.594693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.594757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.594995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.595065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.595136] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a895e100-517f-40a3-99b4-4b43ee1bd032 already deleted. [ 738.595231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.698191] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-481 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.698410] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-481" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.698499] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-481" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.698834] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-481" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.699107] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.699258] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.699375] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.699605] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.699748] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.699947] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.702228] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.702408] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.702530] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.702680] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.702799] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.702935] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.722335] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.722776] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.722974] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.724219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-481" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.724490] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.724662] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.724821] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.725104] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.725242] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8060626-059e-4b3b-a47b-fa02a3e3e6ef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.871347] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 738.871592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.872112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.872331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.872518] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.872636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.872707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.872856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.872939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.873067] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.874036] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.231451] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.231701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.231867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.232202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.232347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.232505] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port b8060626-059e-4b3b-a47b-fa02a3e3e6ef not found, creating... [ 739.232785] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.232965] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.233076] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.233762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.233949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.234280] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.234444] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.234547] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.234803] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.235010] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.235168] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: b8060626-059e-4b3b-a47b-fa02a3e3e6ef is going to be created. [ 739.255234] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.255407] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.255457] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.255721] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.255993] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.256454] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.379792] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.379946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.380073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.380246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.380343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.380436] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 is going to be created. [ 739.381909] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.408233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.408326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.408326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.410073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.410073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.429518] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 in Status: UNINITIALIZED for 2s [ 739.887250] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.100543] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e6f5ebbb-26a4-435d-bbba-4b0318a40f4b None None] Enqueued Resource ID: 8dbd3214-1277-4304-a51a-7d9b83849f5d with Priority: HIGHEST for action port [ 740.100809] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbd3214-1277-4304-a51a-7d9b83849f5d with Priority: HIGHEST for action port [ 740.102931] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dbd3214-1277-4304-a51a-7d9b83849f5d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.103112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dbd3214-1277-4304-a51a-7d9b83849f5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.103112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dbd3214-1277-4304-a51a-7d9b83849f5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.103483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dbd3214-1277-4304-a51a-7d9b83849f5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.103569] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dbd3214-1277-4304-a51a-7d9b83849f5d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.178728] env[69847]: INFO networking_nsxv3.common.synchronization [req-c9389266-dc01-4b2d-9714-70ac609b5f26 req-da512383-788d-46c0-9d2b-e2b8a4cdec71 service nova] Enqueued Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_rules [ 740.179130] env[69847]: INFO networking_nsxv3.common.synchronization [req-c9389266-dc01-4b2d-9714-70ac609b5f26 req-da512383-788d-46c0-9d2b-e2b8a4cdec71 service nova] Enqueued Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_members [ 740.179290] env[69847]: INFO networking_nsxv3.common.synchronization [req-c9389266-dc01-4b2d-9714-70ac609b5f26 req-da512383-788d-46c0-9d2b-e2b8a4cdec71 service nova] Enqueued Resource ID: b8060626-059e-4b3b-a47b-fa02a3e3e6ef with Priority: HIGHEST for action port [ 740.180156] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_rules [ 740.180156] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_members [ 740.180156] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8060626-059e-4b3b-a47b-fa02a3e3e6ef with Priority: HIGHEST for action port [ 740.183093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.183093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.183093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.183093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.183093] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.183882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.184012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.184078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.184259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.184405] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.184502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.184563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.184720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.184791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.184889] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.187909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.188118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.188118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.188328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.188379] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8060626-059e-4b3b-a47b-fa02a3e3e6ef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.391133] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.391133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.391133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.391133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.391133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.391133] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 740.418777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.418914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.419145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.419235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.419381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.428809] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 740.605385] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dbd3214-1277-4304-a51a-7d9b83849f5d [ 740.605623] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.605760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.605828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.606133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.606259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.606378] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dbd3214-1277-4304-a51a-7d9b83849f5d already deleted. [ 740.606481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dbd3214-1277-4304-a51a-7d9b83849f5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.690386] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.690585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.691521] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8060626-059e-4b3b-a47b-fa02a3e3e6ef with status ACTIVE [ 740.691725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.691846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.692731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.692986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.693099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.693281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.693386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.693528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.693609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.693688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.693866] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.693960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.694037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.694186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.694259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.694344] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8060626-059e-4b3b-a47b-fa02a3e3e6ef is going to be updated. [ 740.697374] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.721342] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.721342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.721342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.721342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.721342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.721342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8060626-059e-4b3b-a47b-fa02a3e3e6ef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.201338] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.324315] env[69847]: INFO networking_nsxv3.common.synchronization [None req-588b297f-258b-4ad5-aabe-17d6e56b6af5 tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 741.325046] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 741.327882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.327882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.327882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.327882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.327882] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.432192] env[69847]: INFO networking_nsxv3.common.synchronization [None req-18e18051-cd5b-450f-86ce-3e31533a7c74 tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 741.433112] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 741.433367] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.433467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.440926] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 in Status: SUCCESS [ 741.441864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.441864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.441864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.441864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.441864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.442210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.442210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.442210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.442354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.442354] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.704179] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.704179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.704393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.704634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.704634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.704634] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a895e100-517f-40a3-99b4-4b43ee1bd032 is going to be created. [ 741.727883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.727883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.727883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.729337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.729540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.740441] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a895e100-517f-40a3-99b4-4b43ee1bd032 in Status: UNINITIALIZED for 2s [ 741.847899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.848057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.848057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.848246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.848345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.848462] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f already deleted. [ 741.848561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.848720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.848884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.848967] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.945817] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.314794] env[69847]: INFO networking_nsxv3.common.synchronization [req-8d60d99d-6f85-4180-a114-b1e7e4d5efa5 req-0783ed82-021d-451c-8fdb-60de2dc82ef0 tempest-ListServersNegativeTestJSON-366547923 tempest-ListServersNegativeTestJSON-366547923-project-member] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 742.314794] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 742.314794] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.314794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.372314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.372613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.372694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.372942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.373051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.373144] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f already deleted. [ 742.373225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.440159] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 742.440344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.440583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.440826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.441034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.441190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.441557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.441557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.441557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.441736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.441965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.441965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.442598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.442598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.442598] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.442598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.442856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.442856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.442940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.443174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.443174] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.444153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.444342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.444560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.444766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.444808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.444972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.445196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.445196] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.449947] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67647cd6-2025-4b5b-831e-5ac3f961ef45: rpc.has_security_group_logging(os_id): False [ 742.469189] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.469189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.469189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.469189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.469527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470620] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.470620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.470620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.470620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.470620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.470620] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 is going to be created. [ 742.528755] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.528893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.528963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.529193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.529376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.541808] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 in Status: IN_PROGRESS for 2s [ 742.802450] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d250597e-2900-4637-8dea-f2f25582c063 None None] Enqueued Resource ID: 50ab706e-8c56-4e90-b2a0-c5161f4a72d5 with Priority: HIGHEST for action port [ 742.802713] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ab706e-8c56-4e90-b2a0-c5161f4a72d5 with Priority: HIGHEST for action port [ 742.803301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-50ab706e-8c56-4e90-b2a0-c5161f4a72d5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.803434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50ab706e-8c56-4e90-b2a0-c5161f4a72d5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.803504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50ab706e-8c56-4e90-b2a0-c5161f4a72d5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.803786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50ab706e-8c56-4e90-b2a0-c5161f4a72d5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.803869] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50ab706e-8c56-4e90-b2a0-c5161f4a72d5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.948294] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.952339] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10d780d9-da02-40c2-90cc-6f3fac7afc1f: rpc.has_security_group_logging(os_id): False [ 742.972735] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.972735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.972735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.972939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.972939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.973244] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.973244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.973244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.974221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.974221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.974221] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.974221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.974221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.975549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.976293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.976293] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.976293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.976293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.976293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.976293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.976671] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be created. [ 743.070110] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.070110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.070110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.070110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.070110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.081907] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 743.093565] env[69847]: INFO networking_nsxv3.common.synchronization [req-45bd1d9d-ebee-48d7-ba0e-e2b583840897 req-e47b73a6-dd06-420b-a04a-50ecfa8003eb tempest-MigrationsAdminTest-1749055771 tempest-MigrationsAdminTest-1749055771-project-member] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 743.093565] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 743.093565] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.093565] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.093565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.093565] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.306344] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50ab706e-8c56-4e90-b2a0-c5161f4a72d5 [ 743.306344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.306344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.306628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.306628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.306697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.307141] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50ab706e-8c56-4e90-b2a0-c5161f4a72d5 already deleted. [ 743.307141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50ab706e-8c56-4e90-b2a0-c5161f4a72d5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.454179] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.508867] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.509124] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.509252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.509525] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.509936] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.511726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.511892] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.512200] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.512352] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.512567] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.512683] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.512788] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.512894] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.513007] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.513117] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.513248] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.536555] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.536555] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.536555] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.536907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.537144] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ee5971ef-8f07-4f57-8d25-ac5443c74fba taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.540797] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.540797] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.540797] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.540797] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee5971ef-8f07-4f57-8d25-ac5443c74fba',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.599471] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.600187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.600187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.600187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.600187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.600187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.600419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.600419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.600488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.600597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.601226] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d already deleted. [ 743.601226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.752293] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a895e100-517f-40a3-99b4-4b43ee1bd032 in Status: SUCCESS [ 743.753525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.753525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.753907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.754273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.754437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.754947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.754947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.754947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.754947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.754947] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.959156] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.962066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.962066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.962066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.962066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.962066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 743.988981] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.991038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.991038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.991038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.991038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.998790] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 744.041755] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.042101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.042187] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.042523] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.042731] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.042933] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ee5971ef-8f07-4f57-8d25-ac5443c74fba not found, creating... [ 744.043302] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.043475] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.043596] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.043890] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.044081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.044371] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.044539] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.044651] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.044969] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.045073] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.045222] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ee5971ef-8f07-4f57-8d25-ac5443c74fba is going to be created. [ 744.067824] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.068163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.068281] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.068579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.068833] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.069153] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.257895] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.259275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.259425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.259639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.259847] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.260044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.260958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.260958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.260958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.260958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.260958] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.260958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.260958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.261466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.261466] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.261466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.261466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.261466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.261691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.261691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.261691] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.557349] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 in Status: SUCCESS [ 744.557674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.764262] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a895e100-517f-40a3-99b4-4b43ee1bd032: rpc.has_security_group_logging(os_id): False [ 744.781943] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.784018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.784018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.784976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.785246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.785431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.785703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.785909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.786123] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a895e100-517f-40a3-99b4-4b43ee1bd032 is going to be created. [ 744.846779] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.846919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.846988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.847211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.847385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.859912] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a895e100-517f-40a3-99b4-4b43ee1bd032 in Status: IN_PROGRESS for 2s [ 745.010246] env[69847]: INFO networking_nsxv3.common.synchronization [req-45bd1d9d-ebee-48d7-ba0e-e2b583840897 req-e35be41f-0302-4923-9eb0-b3089a6bcade service nova] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_rules [ 745.010246] env[69847]: INFO networking_nsxv3.common.synchronization [req-45bd1d9d-ebee-48d7-ba0e-e2b583840897 req-e35be41f-0302-4923-9eb0-b3089a6bcade service nova] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 745.010246] env[69847]: INFO networking_nsxv3.common.synchronization [req-45bd1d9d-ebee-48d7-ba0e-e2b583840897 req-e35be41f-0302-4923-9eb0-b3089a6bcade service nova] Enqueued Resource ID: ee5971ef-8f07-4f57-8d25-ac5443c74fba with Priority: HIGHEST for action port [ 745.010246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_rules [ 745.010246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 745.010246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee5971ef-8f07-4f57-8d25-ac5443c74fba with Priority: HIGHEST for action port [ 745.010246] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.010246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.010246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.010246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.010246] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.012563] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.012794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.012936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.013200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.013861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.014190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.014907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.015182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.015937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.015937] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.016929] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee5971ef-8f07-4f57-8d25-ac5443c74fba taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.018037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.018156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.018370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.018511] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee5971ef-8f07-4f57-8d25-ac5443c74fba',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.095018] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 745.095671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.095998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.097249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.097249] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.518069] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.521873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee5971ef-8f07-4f57-8d25-ac5443c74fba with status ACTIVE [ 745.522085] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.522244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.522300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.523221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.523221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.523221] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.523221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.523221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.523861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.523861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.523861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.523861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.523861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.523861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.523861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.524251] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee5971ef-8f07-4f57-8d25-ac5443c74fba is going to be updated. [ 745.525872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.526154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.544624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.544746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.544806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.544996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.545151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.545586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee5971ef-8f07-4f57-8d25-ac5443c74fba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.599101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.599396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.780382] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ebf59b7-b4ca-4283-8e6c-c833a2aa7394 req-ac05c44d-ff8d-4f37-9c1f-dd8be73445eb tempest-ServersWithSpecificFlavorTestJSON-1036324866 tempest-ServersWithSpecificFlavorTestJSON-1036324866-project-member] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 745.780954] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 745.781286] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.781378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.781440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.781709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.781862] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.781962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.782042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.782184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.782270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.782361] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.008703] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 746.008936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.009129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.009356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.009550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.009668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.009734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.009894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.009978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.010172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.010271] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.021254] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.241037] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.241037] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.241037] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.241357] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.241662] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.241830] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.241944] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.245581] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.245888] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.246185] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.246306] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.246432] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.246540] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.246649] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.246752] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.246893] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.270650] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.270897] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.271180] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.271539] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.271911] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ae47afd1-1910-48b7-8316-9f3ab9e6661d taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.272111] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.272232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.272553] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.272692] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae47afd1-1910-48b7-8316-9f3ab9e6661d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.285845] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.286052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.286126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.286419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.286646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.286808] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.286942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.287209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.287273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.287322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.287415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c already deleted. [ 746.287517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.513646] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.513833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.513868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.514124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.514290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.514391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.514452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.514608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.514697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.514782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.514924] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.515028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.515088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.515240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.515377] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.515485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.515528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.515656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.515734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.515812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.515896] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.527194] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.527194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.527194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.527194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.527194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.527194] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be created. [ 746.551329] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.551329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.551329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.551329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.551329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.561341] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: UNINITIALIZED for 2s [ 746.775301] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.775632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.775632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.775930] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.776099] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.776253] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ae47afd1-1910-48b7-8316-9f3ab9e6661d not found, creating... [ 746.776667] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.776667] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.776821] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.779958] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.780162] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.780607] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.780705] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.781403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.781403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.781403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.781403] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ae47afd1-1910-48b7-8316-9f3ab9e6661d is going to be created. [ 746.829332] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.829889] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.829889] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.830261] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.830261] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.830559] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.872884] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a895e100-517f-40a3-99b4-4b43ee1bd032 in Status: SUCCESS [ 746.873273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.022284] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10d780d9-da02-40c2-90cc-6f3fac7afc1f: rpc.has_security_group_logging(os_id): False [ 747.041016] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.041016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.041016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.041341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.041341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.043872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.043872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.043872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.047316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.047517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.047517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.047517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.047985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.047985] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 747.116420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.116595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.116644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.116823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.116978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.131305] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 747.902897] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ebf59b7-b4ca-4283-8e6c-c833a2aa7394 req-b9019043-939e-41d4-a6d3-2e6b8efa4f6e service nova] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 747.902897] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ebf59b7-b4ca-4283-8e6c-c833a2aa7394 req-b9019043-939e-41d4-a6d3-2e6b8efa4f6e service nova] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 747.903198] env[69847]: INFO networking_nsxv3.common.synchronization [req-8ebf59b7-b4ca-4283-8e6c-c833a2aa7394 req-b9019043-939e-41d4-a6d3-2e6b8efa4f6e service nova] Enqueued Resource ID: ae47afd1-1910-48b7-8316-9f3ab9e6661d with Priority: HIGHEST for action port [ 747.903873] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 747.904093] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 747.904259] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae47afd1-1910-48b7-8316-9f3ab9e6661d with Priority: HIGHEST for action port [ 747.904612] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.904786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.904883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.905966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.905966] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.906696] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.906875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.906980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.907236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.907444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.907582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.907680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.907893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.908101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.908167] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.909517] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae47afd1-1910-48b7-8316-9f3ab9e6661d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.911485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.911485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.911485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.911485] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae47afd1-1910-48b7-8316-9f3ab9e6661d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.407243] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.407243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.412094] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.412094] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae47afd1-1910-48b7-8316-9f3ab9e6661d with status ACTIVE [ 748.416304] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.416441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.416508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.416723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.416802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.416994] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.417126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.417186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.417340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.417413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.417602] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.417693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.417748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.417885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.417954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.422222] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae47afd1-1910-48b7-8316-9f3ab9e6661d is going to be updated. [ 748.447685] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.447840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.447900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.448125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.448707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.448707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae47afd1-1910-48b7-8316-9f3ab9e6661d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.573334] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 748.573334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.573334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.573334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.574432] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.575695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.575779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.575995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.576069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.576161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.576251] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.924455] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.079235] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.079395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.079467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.079696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.079885] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.080010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.080082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.080243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.080334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.080420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.080594] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.080698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.080759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.080906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.081056] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.082138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.082138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.082138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.082138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.082138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.082138] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.145928] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 749.145928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.145928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.145928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.145928] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.428915] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.428915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.428915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.428915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.428915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.428915] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be created. [ 749.455617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.455617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.455617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.455617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.455617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.465205] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: UNINITIALIZED for 2s [ 749.586455] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d: rpc.has_security_group_logging(os_id): False [ 749.605140] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.605140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.605140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.605306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.608126] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.608126] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.608126] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.608126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.608755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.608755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.608755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be created. [ 749.650258] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.650258] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.650258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.650258] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.666973] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.667407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.667407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.667407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.667593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.680949] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 750.153816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.154151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.154151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.154402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.154639] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.154753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.154819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.155054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.155175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.155276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.155469] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.155580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.155671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.155867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.156033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.156134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.156215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.156392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.156462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.156553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.156649] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.187709] env[69847]: INFO networking_nsxv3.common.synchronization [req-00d96e3e-af58-4526-a24c-35b30f06c5dd req-876d0e05-abf2-43d4-b8d7-d34a990ce4b0 tempest-ServersTestFqdnHostnames-1597567196 tempest-ServersTestFqdnHostnames-1597567196-project-member] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_members [ 750.189040] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_members [ 750.189201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.189371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.189465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.189767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.189966] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.190130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.190218] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.190405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.190536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.190694] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.663822] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10d780d9-da02-40c2-90cc-6f3fac7afc1f: rpc.has_security_group_logging(os_id): False [ 750.681170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.681309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.681377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.681609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.681708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.682406] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.682406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.682406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.682406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.682406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.682661] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.682661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.682661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.682768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.682940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.683070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.683187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.683222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.683365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.683967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.683967] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 750.693293] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.693423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.693491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.693685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.693775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.693954] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.694538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.694538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.694538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.694538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.694538] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 already deleted. [ 750.694538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.769885] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.769885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.769885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.770286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.770351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.784207] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 750.871431] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.871637] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-130" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.871856] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-130" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.872122] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-130" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.872431] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.872544] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.872659] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.872874] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.876446] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.876813] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.876966] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.877100] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.877216] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.877329] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.877434] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.877567] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.901098] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.902090] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.902822] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.903530] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-130" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.904452] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-96a25c61-2512-4751-8270-a1e12989c64d taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.904649] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.904770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.905148] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.905288] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a25c61-2512-4751-8270-a1e12989c64d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.119170] env[69847]: INFO networking_nsxv3.common.synchronization [None req-1ede447f-8004-4d16-a6ac-0e74a6ebd6ff None None] Enqueued Resource ID: d6164ecd-973c-4abe-b57c-584de2f2f745 with Priority: HIGHEST for action port [ 751.119430] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6164ecd-973c-4abe-b57c-584de2f2f745 with Priority: HIGHEST for action port [ 751.120017] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6164ecd-973c-4abe-b57c-584de2f2f745 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.120140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6164ecd-973c-4abe-b57c-584de2f2f745" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.120201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6164ecd-973c-4abe-b57c-584de2f2f745" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.120451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6164ecd-973c-4abe-b57c-584de2f2f745" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.120528] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6164ecd-973c-4abe-b57c-584de2f2f745',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.409672] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.410044] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.410044] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.410322] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.410474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.410708] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 96a25c61-2512-4751-8270-a1e12989c64d not found, creating... [ 751.414019] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.414019] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.414019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.414470] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 96a25c61-2512-4751-8270-a1e12989c64d is going to be created. [ 751.431425] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.432694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.432694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.432694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.432694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.432694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.478912] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 751.479128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.480485] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.480485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.480485] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.624511] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6164ecd-973c-4abe-b57c-584de2f2f745 [ 751.624682] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.624682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.624826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.625066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.625066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.625232] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6164ecd-973c-4abe-b57c-584de2f2f745 already deleted. [ 751.625232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6164ecd-973c-4abe-b57c-584de2f2f745" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.696047] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 751.696276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.986136] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.488432] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2390abe6-0ba8-4ab0-8c91-187bd39ef80c: rpc.has_security_group_logging(os_id): False [ 752.516201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.516201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.516201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.516450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.516491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.517140] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.517140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.517140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.517341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.517341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.519944] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be created. [ 752.577908] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.577908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.577908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.577908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.577908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.595554] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: IN_PROGRESS for 2s [ 752.597337] env[69847]: INFO networking_nsxv3.common.synchronization [req-00d96e3e-af58-4526-a24c-35b30f06c5dd req-0c9f303f-7a06-4647-b6ac-23b2e05a52a3 service nova] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_rules [ 752.597511] env[69847]: INFO networking_nsxv3.common.synchronization [req-00d96e3e-af58-4526-a24c-35b30f06c5dd req-0c9f303f-7a06-4647-b6ac-23b2e05a52a3 service nova] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_members [ 752.597649] env[69847]: INFO networking_nsxv3.common.synchronization [req-00d96e3e-af58-4526-a24c-35b30f06c5dd req-0c9f303f-7a06-4647-b6ac-23b2e05a52a3 service nova] Enqueued Resource ID: 96a25c61-2512-4751-8270-a1e12989c64d with Priority: HIGHEST for action port [ 752.597873] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_rules [ 752.597996] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_members [ 752.598111] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a25c61-2512-4751-8270-a1e12989c64d with Priority: HIGHEST for action port [ 752.598725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.598835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.598902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.599242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.599351] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.600207] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.600367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.601032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.601032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.601032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.601226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.601226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.601367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.601472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.601654] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.602551] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-96a25c61-2512-4751-8270-a1e12989c64d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.602697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.602781] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.602954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.603088] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a25c61-2512-4751-8270-a1e12989c64d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.646179] env[69847]: INFO networking_nsxv3.common.synchronization [None req-fc49d9ba-3eb5-4e61-8ac5-deafe235d972 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 752.646711] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 752.647111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.647241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.647309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.647856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.647949] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.806052] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 752.806052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.056525] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b2de8b6d-73bf-40cc-a737-c1e1b4f09c72 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 753.057171] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 753.057521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.057624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.106320] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.108385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.108385] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.108385] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96a25c61-2512-4751-8270-a1e12989c64d with status ACTIVE [ 753.108385] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.108385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.108385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.108385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.109069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.109069] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.109069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.109069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.109444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.109444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.109444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.109611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.109611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.109711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.109762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.109823] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96a25c61-2512-4751-8270-a1e12989c64d is going to be updated. [ 753.131572] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.131703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.131748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.132315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.132315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.132315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96a25c61-2512-4751-8270-a1e12989c64d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.174329] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.174329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.174329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.175635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.175635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.175635] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad already deleted. [ 753.175635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.175635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.176758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.176758] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.447979] env[69847]: INFO networking_nsxv3.common.synchronization [None req-091ea3bb-55d5-4c92-85a5-d2259e842f30 None None] Enqueued Resource ID: 32b042c7-91bc-4d57-91e9-2b4d843649b4 with Priority: HIGHEST for action port [ 753.448760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b042c7-91bc-4d57-91e9-2b4d843649b4 with Priority: HIGHEST for action port [ 753.452055] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-32b042c7-91bc-4d57-91e9-2b4d843649b4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.452055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32b042c7-91bc-4d57-91e9-2b4d843649b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.452055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32b042c7-91bc-4d57-91e9-2b4d843649b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.452055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32b042c7-91bc-4d57-91e9-2b4d843649b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.452055] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32b042c7-91bc-4d57-91e9-2b4d843649b4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.612893] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.702372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.705138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.705138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.705138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.705138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.705138] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad already deleted. [ 753.705138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.955482] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32b042c7-91bc-4d57-91e9-2b4d843649b4 [ 753.955482] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.955482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.955482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.955482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.955482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.955482] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32b042c7-91bc-4d57-91e9-2b4d843649b4 already deleted. [ 753.955482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32b042c7-91bc-4d57-91e9-2b4d843649b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.114947] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.115110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.115178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.115419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.115500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.116213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 is going to be created. [ 754.140038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.140176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.140243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.140446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.140608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.151094] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 in Status: UNINITIALIZED for 2s [ 754.611037] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 754.611037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.004888] env[69847]: INFO networking_nsxv3.common.synchronization [req-3452afad-2369-4b01-a7cf-f2f2f2715590 req-25d3ee8c-a6fe-4b16-a7d0-b62d5f7f899c tempest-ServersAdminNegativeTestJSON-26222337 tempest-ServersAdminNegativeTestJSON-26222337-project-member] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 755.005855] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 755.005855] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.006092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.006214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.007216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.007216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.007216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.007216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.007216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.007216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.007216] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.046046] env[69847]: INFO networking_nsxv3.common.synchronization [req-8d24fe00-3906-4947-8be3-8bdf15e90811 req-2b0e7491-709c-45fc-b0b9-90a2d874814d tempest-ListServerFiltersTestJSON-552165178 tempest-ListServerFiltersTestJSON-552165178-project-member] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 755.046442] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 755.046752] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.046877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.046938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.047184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.047632] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.047632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.047632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.047632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.047877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.047877] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.463096] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.463096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.463935] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.463935] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.464166] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.464480] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.464590] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.464848] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.465142] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.465366] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.465531] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.465587] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.465829] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.469087] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 755.469087] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.469087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.489510] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.489510] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.489510] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.489510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.489510] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-44257846-b665-4cf5-b3a2-537b1bf7812e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.489510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.489510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.489510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.489510] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44257846-b665-4cf5-b3a2-537b1bf7812e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.511907] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.550259] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.831132] env[69847]: INFO networking_nsxv3.common.synchronization [req-74579814-6df7-4699-87ff-c1e80132182f req-1a0bf6a3-d041-47c0-abef-0ccc508946e7 tempest-ServerMetadataNegativeTestJSON-1309640846 tempest-ServerMetadataNegativeTestJSON-1309640846-project-member] Enqueued Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_members [ 755.831667] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGHEST for action security_group_members [ 755.832625] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.832935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.833127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.833572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.833833] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.834074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.834703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.834703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.834703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.834703] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.995061] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.995061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 44257846-b665-4cf5-b3a2-537b1bf7812e not found, creating... [ 755.995061] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.995061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.995855] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.995855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.995855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.996822] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.996973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.997144] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 44257846-b665-4cf5-b3a2-537b1bf7812e is going to be created. [ 756.017278] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.017632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.017677] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.017984] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.018199] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.018440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.019667] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.053143] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.165522] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 in Status: SUCCESS [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.165522] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.165522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.166285] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.337197] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.337442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.337543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.337813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.337938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.338528] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.338818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.338818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.339365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.339365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.339365] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a895e100-517f-40a3-99b4-4b43ee1bd032 is going to be updated. [ 756.383000] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.383416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.383416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.383560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.383875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.392456] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a895e100-517f-40a3-99b4-4b43ee1bd032 in Status: IN_PROGRESS for 2s [ 756.523261] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.523261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.523261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.523261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.523261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.523261] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be updated. [ 756.551743] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.551905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.551975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.552566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.552720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.554644] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.554772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.554828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.554991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.555086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.555176] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 756.563232] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 2s [ 756.584558] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.584716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.584767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.584967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.585148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.594068] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 756.668614] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.737874] env[69847]: INFO networking_nsxv3.common.synchronization [req-3452afad-2369-4b01-a7cf-f2f2f2715590 req-129b212b-c6c2-416f-91b8-75bc4d789267 service nova] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_rules [ 756.738064] env[69847]: INFO networking_nsxv3.common.synchronization [req-3452afad-2369-4b01-a7cf-f2f2f2715590 req-129b212b-c6c2-416f-91b8-75bc4d789267 service nova] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 756.738206] env[69847]: INFO networking_nsxv3.common.synchronization [req-3452afad-2369-4b01-a7cf-f2f2f2715590 req-129b212b-c6c2-416f-91b8-75bc4d789267 service nova] Enqueued Resource ID: 44257846-b665-4cf5-b3a2-537b1bf7812e with Priority: HIGHEST for action port [ 756.738431] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_rules [ 756.738562] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 756.738656] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44257846-b665-4cf5-b3a2-537b1bf7812e with Priority: HIGHEST for action port [ 756.740177] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.740354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.741357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.741670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.741781] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.742726] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.742829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.743227] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-44257846-b665-4cf5-b3a2-537b1bf7812e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.743377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.743642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.744039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.744096] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44257846-b665-4cf5-b3a2-537b1bf7812e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.172314] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9b9bce3-208c-4b60-a51a-b29860fe98d3: rpc.has_security_group_logging(os_id): False [ 757.216989] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.217151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.217223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.217441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.217528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.217775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.217925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.217925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.218090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.218164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.218247] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 is going to be created. [ 757.248199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.248199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.248391] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44257846-b665-4cf5-b3a2-537b1bf7812e with status ACTIVE [ 757.248491] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.248595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.248633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.248845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.248935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.249121] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.249214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.249273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.249442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.251191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.251478] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.251587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.251652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.251829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.251909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.251993] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44257846-b665-4cf5-b3a2-537b1bf7812e is going to be updated. [ 757.293544] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.293698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.293769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.294088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.294299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.294499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44257846-b665-4cf5-b3a2-537b1bf7812e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.310536] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.310536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.310536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.310536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.310536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.324273] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 in Status: IN_PROGRESS for 2s [ 757.833438] env[69847]: INFO networking_nsxv3.common.synchronization [None req-633b5cb8-8424-49ca-9c91-e427afc24f2b None None] Enqueued Resource ID: 17cb8e53-4636-4842-a447-642768ad192e with Priority: HIGHEST for action port [ 757.833994] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17cb8e53-4636-4842-a447-642768ad192e with Priority: HIGHEST for action port [ 757.834337] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-17cb8e53-4636-4842-a447-642768ad192e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.834430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17cb8e53-4636-4842-a447-642768ad192e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.834430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17cb8e53-4636-4842-a447-642768ad192e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.834675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17cb8e53-4636-4842-a447-642768ad192e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.834757] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17cb8e53-4636-4842-a447-642768ad192e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.339791] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17cb8e53-4636-4842-a447-642768ad192e [ 758.340184] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.340367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.340455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.341941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.341941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.341941] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17cb8e53-4636-4842-a447-642768ad192e already deleted. [ 758.341941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17cb8e53-4636-4842-a447-642768ad192e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.406642] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a895e100-517f-40a3-99b4-4b43ee1bd032 in Status: SUCCESS [ 758.406642] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a895e100-517f-40a3-99b4-4b43ee1bd032 deletion is rescheduled due to dependency. [ 758.406642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.573750] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 758.573750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.574614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.575473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.575473] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.575473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.575693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.575693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.575789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.575893] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.606977] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 758.607249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.078574] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.339183] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 in Status: SUCCESS [ 759.339183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.585013] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.089887] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.089887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.089887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.089887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.089887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.089887] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be updated. [ 760.124408] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.124592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.125589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.125589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.125589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.135492] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 2s [ 760.373859] env[69847]: INFO networking_nsxv3.common.synchronization [None req-93c3b889-b6eb-4090-9764-a823a7a072a6 None None] Enqueued Resource ID: a3b9ffc7-0260-493e-877f-ed1cd86d8da1 with Priority: HIGHEST for action port [ 760.374157] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3b9ffc7-0260-493e-877f-ed1cd86d8da1 with Priority: HIGHEST for action port [ 760.374714] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3b9ffc7-0260-493e-877f-ed1cd86d8da1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.378021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3b9ffc7-0260-493e-877f-ed1cd86d8da1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.378021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3b9ffc7-0260-493e-877f-ed1cd86d8da1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.378021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3b9ffc7-0260-493e-877f-ed1cd86d8da1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.378021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3b9ffc7-0260-493e-877f-ed1cd86d8da1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.877415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3b9ffc7-0260-493e-877f-ed1cd86d8da1 [ 760.877683] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.877781] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.877870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.878253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.878253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.878355] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3b9ffc7-0260-493e-877f-ed1cd86d8da1 already deleted. [ 760.878355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3b9ffc7-0260-493e-877f-ed1cd86d8da1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.293796] env[69847]: INFO networking_nsxv3.common.synchronization [None req-0931e18e-d47c-429d-b7b8-b84875b2848d None None] Enqueued Resource ID: c84bf539-ca9e-4a64-914d-25c0b161c643 with Priority: HIGHEST for action port [ 761.295210] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c84bf539-ca9e-4a64-914d-25c0b161c643 with Priority: HIGHEST for action port [ 761.295210] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c84bf539-ca9e-4a64-914d-25c0b161c643 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.295210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c84bf539-ca9e-4a64-914d-25c0b161c643" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.295210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c84bf539-ca9e-4a64-914d-25c0b161c643" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.296204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c84bf539-ca9e-4a64-914d-25c0b161c643" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.296341] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84bf539-ca9e-4a64-914d-25c0b161c643',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.800360] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c84bf539-ca9e-4a64-914d-25c0b161c643 [ 761.800597] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.800763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.800833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.801080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.801167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.801260] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c84bf539-ca9e-4a64-914d-25c0b161c643 already deleted. [ 761.801331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c84bf539-ca9e-4a64-914d-25c0b161c643" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.151184] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 4s [ 763.249111] env[69847]: INFO networking_nsxv3.common.synchronization [req-fda451cd-ff37-426c-851c-3f55e4fe3006 req-de157f18-c790-4cbc-a856-52d9121e6364 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_members [ 763.249111] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_members [ 763.249770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.250113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.250258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.251182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.251483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.251736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.251949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.252247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.253551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.253551] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.711717] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.711943] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.712088] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.712960] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.715774] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.716065] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.716295] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.716463] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.716615] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.716852] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.716969] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.717095] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.717202] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.717311] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.717416] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.717550] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.740793] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.740903] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 763.741049] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.741322] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.741659] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.741884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.741997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.742351] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.742488] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b2d62f-557a-40df-8c4a-6b2992ceb3fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.756296] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.756296] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.756296] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 already deleted. [ 763.756296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.161572] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 764.161782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.162393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.162393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.162393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.162520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.162520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.162672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.162758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.162841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.162927] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.248101] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.248101] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 52b2d62f-557a-40df-8c4a-6b2992ceb3fd not found, creating... [ 764.248101] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.248101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.248598] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.248598] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.248598] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.248598] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.248598] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.248598] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 52b2d62f-557a-40df-8c4a-6b2992ceb3fd is going to be created. [ 764.272266] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.272266] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.272266] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.272266] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.272266] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.272266] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.665108] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.665824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.665824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.665824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.666082] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.666225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.666295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.666503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.666597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.666686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.666850] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.666946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.666996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.667156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.667291] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.667380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.667430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.667569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.667641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.667717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.667801] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.014152] env[69847]: INFO networking_nsxv3.common.synchronization [req-fda451cd-ff37-426c-851c-3f55e4fe3006 req-34525447-9fa7-4649-a199-4a99715e63c5 service nova] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_rules [ 765.014334] env[69847]: INFO networking_nsxv3.common.synchronization [req-fda451cd-ff37-426c-851c-3f55e4fe3006 req-34525447-9fa7-4649-a199-4a99715e63c5 service nova] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_members [ 765.014472] env[69847]: INFO networking_nsxv3.common.synchronization [req-fda451cd-ff37-426c-851c-3f55e4fe3006 req-34525447-9fa7-4649-a199-4a99715e63c5 service nova] Enqueued Resource ID: 52b2d62f-557a-40df-8c4a-6b2992ceb3fd with Priority: HIGHEST for action port [ 765.014697] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_rules [ 765.014826] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_members [ 765.014923] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b2d62f-557a-40df-8c4a-6b2992ceb3fd with Priority: HIGHEST for action port [ 765.015470] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.015599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.015758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.016026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.016064] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.017045] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.017161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.017229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.017424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.017597] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.017698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.017760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.017908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.017993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.018097] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.019035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.019185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.019292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.019548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.019655] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b2d62f-557a-40df-8c4a-6b2992ceb3fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.169971] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1f264c4-f165-4427-b9e3-23d05179073b: rpc.has_security_group_logging(os_id): False [ 765.187163] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.187344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.187385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.187584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.187676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.187864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.187992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.188074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.188237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.188317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.188521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.188615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.188677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.188820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.188893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.189082] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.189256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.189256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.189398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.189436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.189518] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be updated. [ 765.246029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.246217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.246286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.246479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.246626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.258496] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 2s [ 765.521916] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.524574] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.524696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.524831] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52b2d62f-557a-40df-8c4a-6b2992ceb3fd with status ACTIVE [ 765.524985] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.525128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.525198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.525372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.525464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.525629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.525725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.525776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.525933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.526017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.526199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.526286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.526343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.526494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.526567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.526649] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52b2d62f-557a-40df-8c4a-6b2992ceb3fd is going to be updated. [ 765.548793] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.548968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.549072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.549249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.549380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.549528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52b2d62f-557a-40df-8c4a-6b2992ceb3fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.029688] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.393796] env[69847]: INFO networking_nsxv3.common.synchronization [req-a2d17944-6287-4ed6-8491-ad219e7f2224 req-36e4ab19-f1db-43dd-b1aa-7ab693952cf6 tempest-FloatingIPsAssociationTestJSON-943086566 tempest-FloatingIPsAssociationTestJSON-943086566-project-member] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 766.394368] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 766.395035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.395180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.395271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.395476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.395641] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.397353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.397493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.397679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.397758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.397855] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.532117] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.532383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.532383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.532552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.532643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.532735] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 is going to be created. [ 766.559648] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.560349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.562027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.562027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.562027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.570322] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea12339-45c6-49af-909a-f5d031f10029 in Status: UNINITIALIZED for 2s [ 766.901637] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.026515] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.026709] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.026832] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.027126] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.027381] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.027537] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.031245] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.031245] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.031245] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.031245] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.031245] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.031245] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.031245] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.031245] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.031245] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.031245] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.048321] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.048551] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.048688] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.048873] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-16" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.050011] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-37f450da-81eb-40c7-9b97-04108d89598a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.050011] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.050011] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.050011] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.050214] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f450da-81eb-40c7-9b97-04108d89598a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.062271] env[69847]: INFO networking_nsxv3.common.synchronization [None req-95cfff96-025d-429e-90be-0e50c46ba876 None None] Enqueued Resource ID: 2585f5be-c546-4faa-8966-e5f5ee341f47 with Priority: HIGHEST for action port [ 767.062271] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2585f5be-c546-4faa-8966-e5f5ee341f47 with Priority: HIGHEST for action port [ 767.062271] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2585f5be-c546-4faa-8966-e5f5ee341f47 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.062271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2585f5be-c546-4faa-8966-e5f5ee341f47" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.062271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2585f5be-c546-4faa-8966-e5f5ee341f47" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.062271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2585f5be-c546-4faa-8966-e5f5ee341f47" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.062271] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2585f5be-c546-4faa-8966-e5f5ee341f47',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.272191] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 767.272191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.404541] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.553654] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.553914] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.554018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.554307] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.554462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.554615] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 37f450da-81eb-40c7-9b97-04108d89598a not found, creating... [ 767.554878] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.555087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.555219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.555448] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.555587] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.555867] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.556217] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.556411] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.556672] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.556867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.557103] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 37f450da-81eb-40c7-9b97-04108d89598a is going to be created. [ 767.567437] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2585f5be-c546-4faa-8966-e5f5ee341f47 [ 767.567437] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.567437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.567437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.567437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.567737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.567840] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2585f5be-c546-4faa-8966-e5f5ee341f47 already deleted. [ 767.567979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2585f5be-c546-4faa-8966-e5f5ee341f47" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.578277] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.578471] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.578595] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.578857] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.579123] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.579348] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.907783] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.908668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.908668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.908668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.908668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.908668] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be updated. [ 767.935788] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.936020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.936090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.936311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.936446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.947196] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: IN_PROGRESS for 2s [ 768.095265] env[69847]: INFO networking_nsxv3.common.synchronization [None req-285a6014-5518-4474-8122-3bc76948f82f tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_rules [ 768.096343] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_rules [ 768.096343] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.096526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.096526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.096794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.096794] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.245156] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4192c77e-ca62-4e34-9b50-18ee750bebca tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_rules [ 768.245156] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_rules [ 768.245588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.245856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.419459] env[69847]: INFO networking_nsxv3.common.synchronization [req-a2d17944-6287-4ed6-8491-ad219e7f2224 req-dc93eaa4-a81a-48c2-bb5b-d91697808aa1 service nova] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_rules [ 768.419459] env[69847]: INFO networking_nsxv3.common.synchronization [req-a2d17944-6287-4ed6-8491-ad219e7f2224 req-dc93eaa4-a81a-48c2-bb5b-d91697808aa1 service nova] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 768.419608] env[69847]: INFO networking_nsxv3.common.synchronization [req-a2d17944-6287-4ed6-8491-ad219e7f2224 req-dc93eaa4-a81a-48c2-bb5b-d91697808aa1 service nova] Enqueued Resource ID: 37f450da-81eb-40c7-9b97-04108d89598a with Priority: HIGHEST for action port [ 768.419781] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_rules [ 768.419906] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 768.420012] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f450da-81eb-40c7-9b97-04108d89598a with Priority: HIGHEST for action port [ 768.420562] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.420719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.420749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.420994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.422354] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.426806] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.426909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.427273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-37f450da-81eb-40c7-9b97-04108d89598a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.427388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.427453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.427649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.428636] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f450da-81eb-40c7-9b97-04108d89598a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.581857] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea12339-45c6-49af-909a-f5d031f10029 in Status: SUCCESS [ 768.583330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.583330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.585025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.585025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.585025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.585025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.585025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.585025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.585025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.585025] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.618317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.618991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.620812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.620812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.620812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.620812] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 already deleted. [ 768.620812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.620812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.620812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.620812] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.930615] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.930716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.930984] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37f450da-81eb-40c7-9b97-04108d89598a with status ACTIVE [ 768.931174] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.931281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.931351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.931928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.931928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.931928] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.931928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.932124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.932124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.932223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.932429] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.932534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.932596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.932747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.932829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.932940] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37f450da-81eb-40c7-9b97-04108d89598a is going to be updated. [ 768.942030] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c9ce5606-c0ef-45aa-959a-6edc53a198b0 None None] Enqueued Resource ID: 95fcb460-0b55-4904-ba3a-cf6d2f7e9340 with Priority: HIGHEST for action port [ 768.942030] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95fcb460-0b55-4904-ba3a-cf6d2f7e9340 with Priority: HIGHEST for action port [ 768.942030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-95fcb460-0b55-4904-ba3a-cf6d2f7e9340 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.942030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95fcb460-0b55-4904-ba3a-cf6d2f7e9340" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.942030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95fcb460-0b55-4904-ba3a-cf6d2f7e9340" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.942030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95fcb460-0b55-4904-ba3a-cf6d2f7e9340" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.942030] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95fcb460-0b55-4904-ba3a-cf6d2f7e9340',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.954262] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.954437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.954437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.954818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.954818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.954974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37f450da-81eb-40c7-9b97-04108d89598a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.089324] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.145454] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.145617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.145700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.145951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.146119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.146272] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 already deleted. [ 769.146417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.442380] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95fcb460-0b55-4904-ba3a-cf6d2f7e9340 [ 769.442627] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.442757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.443340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.443340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.443340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.443340] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95fcb460-0b55-4904-ba3a-cf6d2f7e9340 already deleted. [ 769.443340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95fcb460-0b55-4904-ba3a-cf6d2f7e9340" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.592445] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ea12339-45c6-49af-909a-f5d031f10029: rpc.has_security_group_logging(os_id): False [ 769.610736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.610978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.611076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.611284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.611374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.611736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.611870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.611939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.612120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.612247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.612302] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 is going to be created. [ 769.675932] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.675932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.675932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.675932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.675932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.685275] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ea12339-45c6-49af-909a-f5d031f10029 in Status: IN_PROGRESS for 2s [ 769.957341] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 769.957341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.957520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.957736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.958110] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.958110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.958222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.958336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.958409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.958558] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.460700] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.962997] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.467114] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.467247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.467407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.467664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.467769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.467867] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be updated. [ 771.495060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.495232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.495279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.495478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.495642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.503144] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: IN_PROGRESS for 2s [ 771.698563] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ea12339-45c6-49af-909a-f5d031f10029 in Status: SUCCESS [ 771.698811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.152069] env[69847]: INFO networking_nsxv3.common.synchronization [req-59975306-c672-4432-b7a4-03117bb6f587 req-ed3f0fb6-eca7-4c71-a100-8f2278a63dd0 tempest-ServersAdminNegativeTestJSON-26222337 tempest-ServersAdminNegativeTestJSON-26222337-project-member] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 772.153762] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 772.153762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.153762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.153762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.154237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.154267] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.154385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.154435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.154608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.154691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.154789] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.658054] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.161694] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.217370] env[69847]: INFO networking_nsxv3.common.synchronization [req-17334a26-5dcd-4ea0-ab93-0f6c36fefb51 req-f50c0fc4-2583-4647-9c65-5a1fc2e74ecf tempest-ImagesNegativeTestJSON-1043089708 tempest-ImagesNegativeTestJSON-1043089708-project-member] Enqueued Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_members [ 773.217820] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_members [ 773.218132] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.218262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.218331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.218579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.218730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.218827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.218889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.220258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.220329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.220432] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.512990] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 773.513318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.513760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.514230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.514230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.514407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.514407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.514506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.514828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.514828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.514828] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.653164] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.653391] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-142" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.653513] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-142" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.653838] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-142" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.654720] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.654897] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.655028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.655269] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.655474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.655694] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.655810] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.655918] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.656034] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.656146] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.656252] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.656379] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.667178] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.667319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.667382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.667568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.667661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.667754] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be updated. [ 773.673761] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.673914] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.674097] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.674286] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-142" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.674784] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-12e1ff19-933e-40ab-b9d8-670bfb8648fd taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.674952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.675118] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.675445] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.675587] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e1ff19-933e-40ab-b9d8-670bfb8648fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.692533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.692715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.692715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.692927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.693120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.702455] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 2s [ 773.722499] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.722656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.722656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.722863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.722958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.723179] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.723283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.723345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.723509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.723590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.723674] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 already deleted. [ 773.723755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.019435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.019612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.019681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.019948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.020128] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.020225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.020286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.020444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.020526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.020610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.020752] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.020851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.020924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.021088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.021276] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.021372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.021431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.021587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.021671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.021761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.021866] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.178375] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.178694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.178738] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.180020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.180020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.180020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 12e1ff19-933e-40ab-b9d8-670bfb8648fd not found, creating... [ 774.180020] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.180020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.180020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.180291] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.180328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.180588] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.180742] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.180861] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.181722] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.181932] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.182130] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 12e1ff19-933e-40ab-b9d8-670bfb8648fd is going to be created. [ 774.206788] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.207013] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.207136] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.207421] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.207647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.207884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.326458] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ee224aa7-7538-4670-988e-33d54ff20e8a None None] Enqueued Resource ID: 237235d8-27d2-416f-8acd-603f06aaf20c with Priority: HIGHEST for action port [ 774.326997] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237235d8-27d2-416f-8acd-603f06aaf20c with Priority: HIGHEST for action port [ 774.329287] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-237235d8-27d2-416f-8acd-603f06aaf20c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.329287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-237235d8-27d2-416f-8acd-603f06aaf20c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.329287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-237235d8-27d2-416f-8acd-603f06aaf20c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.329601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-237235d8-27d2-416f-8acd-603f06aaf20c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.330649] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237235d8-27d2-416f-8acd-603f06aaf20c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.526952] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 538bdf43-fa07-48d1-906e-f7fa68a3a739: rpc.has_security_group_logging(os_id): False [ 774.543925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.544091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.544529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.544809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.544915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.545128] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.545228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.545295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.545455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.545537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.546533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.546533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.546533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.546533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.546533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.546533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.546533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.546533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.546901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.546901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.546901] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be updated. [ 774.602305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.602463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.602631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.602766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.602926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.615010] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: IN_PROGRESS for 2s [ 774.832453] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 237235d8-27d2-416f-8acd-603f06aaf20c [ 774.834047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.834047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.834047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.834047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.834047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.834047] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:237235d8-27d2-416f-8acd-603f06aaf20c already deleted. [ 774.834047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-237235d8-27d2-416f-8acd-603f06aaf20c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.910087] env[69847]: INFO networking_nsxv3.common.synchronization [req-17334a26-5dcd-4ea0-ab93-0f6c36fefb51 req-230e9047-3554-48e1-8273-9769ba6d3e24 service nova] Enqueued Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_rules [ 774.910087] env[69847]: INFO networking_nsxv3.common.synchronization [req-17334a26-5dcd-4ea0-ab93-0f6c36fefb51 req-230e9047-3554-48e1-8273-9769ba6d3e24 service nova] Enqueued Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_members [ 774.910171] env[69847]: INFO networking_nsxv3.common.synchronization [req-17334a26-5dcd-4ea0-ab93-0f6c36fefb51 req-230e9047-3554-48e1-8273-9769ba6d3e24 service nova] Enqueued Resource ID: 12e1ff19-933e-40ab-b9d8-670bfb8648fd with Priority: HIGHEST for action port [ 774.910352] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_rules [ 774.910476] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_members [ 774.910571] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e1ff19-933e-40ab-b9d8-670bfb8648fd with Priority: HIGHEST for action port [ 774.911292] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.911292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.911397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.911608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.911689] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.912533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.912663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.912697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.913241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.913241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.913241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.913241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.913493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.913493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.913493] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.914194] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e1ff19-933e-40ab-b9d8-670bfb8648fd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.914309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.914375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.915372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.915372] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e1ff19-933e-40ab-b9d8-670bfb8648fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.421123] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.421476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.421476] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.425061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12e1ff19-933e-40ab-b9d8-670bfb8648fd with status ACTIVE [ 775.425061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.425061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.425061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.425061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.425061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12e1ff19-933e-40ab-b9d8-670bfb8648fd is going to be updated. [ 775.443170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.443380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.443380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.443548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.443673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.443872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e1ff19-933e-40ab-b9d8-670bfb8648fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.712818] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 775.712818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.929942] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.268191] env[69847]: INFO networking_nsxv3.common.synchronization [req-0cef7be2-1311-4ef0-92d7-0fd7f5ba4b4b req-79c0485e-a28a-443d-a29f-476efc199073 tempest-FloatingIPsAssociationNegativeTestJSON-1675387201 tempest-FloatingIPsAssociationNegativeTestJSON-1675387201-project-member] Enqueued Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_members [ 776.269017] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_members [ 776.270148] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.270148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.270503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.272411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.272411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.272411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.272411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.272411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.272411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.272411] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.437070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.437070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.437070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.437070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.437070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.437070] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 is going to be created. [ 776.457313] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.457463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.458599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.458599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.458599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.468586] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 in Status: UNINITIALIZED for 2s [ 776.630146] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 776.630146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.693283] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.693561] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-844" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.693686] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-844" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.694194] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-844" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.694462] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.694612] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.694724] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.694950] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.695103] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.695306] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.695412] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.695512] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.695944] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.696224] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.696369] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.696666] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.714278] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.714435] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.714574] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.714747] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-844" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.715070] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-9587e7c3-2910-45d7-bc62-1907f5379b45 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.715844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.715844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.715844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.715844] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9587e7c3-2910-45d7-bc62-1907f5379b45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.778762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.778762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.778762] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 already deleted. [ 776.778762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.779674] env[69847]: INFO networking_nsxv3.common.synchronization [None req-185711c2-a317-4c6f-a213-9a3df87fdaff None None] Enqueued Resource ID: 4770d4b5-3c3f-4754-8703-db6f66359b36 with Priority: HIGHEST for action port [ 776.780247] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4770d4b5-3c3f-4754-8703-db6f66359b36 with Priority: HIGHEST for action port [ 776.780520] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4770d4b5-3c3f-4754-8703-db6f66359b36 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.780622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4770d4b5-3c3f-4754-8703-db6f66359b36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.780705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4770d4b5-3c3f-4754-8703-db6f66359b36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.780949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4770d4b5-3c3f-4754-8703-db6f66359b36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.781045] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4770d4b5-3c3f-4754-8703-db6f66359b36',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.221465] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.221465] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 9587e7c3-2910-45d7-bc62-1907f5379b45 not found, creating... [ 777.221465] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.221465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.222070] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.222070] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.222724] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.222724] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.222985] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.227025] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.227025] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 9587e7c3-2910-45d7-bc62-1907f5379b45 is going to be created. [ 777.244025] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.245131] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.245384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.245730] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.246068] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.246396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.283199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4770d4b5-3c3f-4754-8703-db6f66359b36 [ 777.284023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.284286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.284438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.284736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.288034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.288034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4770d4b5-3c3f-4754-8703-db6f66359b36 already deleted. [ 777.288034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4770d4b5-3c3f-4754-8703-db6f66359b36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.097375] env[69847]: INFO networking_nsxv3.common.synchronization [req-0cef7be2-1311-4ef0-92d7-0fd7f5ba4b4b req-02862c81-7130-40b7-9d52-ce0e4a484f02 service nova] Enqueued Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_rules [ 778.097375] env[69847]: INFO networking_nsxv3.common.synchronization [req-0cef7be2-1311-4ef0-92d7-0fd7f5ba4b4b req-02862c81-7130-40b7-9d52-ce0e4a484f02 service nova] Enqueued Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_members [ 778.097375] env[69847]: INFO networking_nsxv3.common.synchronization [req-0cef7be2-1311-4ef0-92d7-0fd7f5ba4b4b req-02862c81-7130-40b7-9d52-ce0e4a484f02 service nova] Enqueued Resource ID: 9587e7c3-2910-45d7-bc62-1907f5379b45 with Priority: HIGHEST for action port [ 778.097375] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_rules [ 778.097375] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_members [ 778.097375] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9587e7c3-2910-45d7-bc62-1907f5379b45 with Priority: HIGHEST for action port [ 778.097375] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.097375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.097375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.097375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.097375] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.098625] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.098625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.098625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.099143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.099366] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.099497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.099585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.099776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.100224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.100369] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.104430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9587e7c3-2910-45d7-bc62-1907f5379b45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.104577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.104631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.104779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.104850] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9587e7c3-2910-45d7-bc62-1907f5379b45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.481145] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 in Status: SUCCESS [ 778.481413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.481581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.481805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.482069] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.482201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.482264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.482441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.482526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.482615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.482704] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.604994] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.613965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.613965] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9587e7c3-2910-45d7-bc62-1907f5379b45 with status ACTIVE [ 778.613965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.613965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.613965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.613965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.614661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.614661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.614661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.614661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.614661] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9587e7c3-2910-45d7-bc62-1907f5379b45 is going to be updated. [ 778.632892] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.634378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.634378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.634378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.634378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.634378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9587e7c3-2910-45d7-bc62-1907f5379b45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.985406] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.987079] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.987079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.987079] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.987573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.987573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.987573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.987573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.987695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.987695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.989106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.989106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.989106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.989106] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.116916] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.490651] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d49fbfa3-cbed-486e-8169-864e1a046ae7: rpc.has_security_group_logging(os_id): False [ 779.508036] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.508036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.508239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.508325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.508413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.508681] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.508782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.508841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.509021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.509108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.509283] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.509376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.509464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.509570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.509642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.509822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.509906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.509965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.510888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.511090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.511154] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 is going to be created. [ 779.570381] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.570524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.570644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.570835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.571226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.583134] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 in Status: IN_PROGRESS for 2s [ 779.623904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.624095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.624163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.624440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.624493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.624573] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 is going to be created. [ 779.646679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.646679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.646679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.646865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.647033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.655547] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 in Status: UNINITIALIZED for 2s [ 781.328426] env[69847]: INFO networking_nsxv3.common.synchronization [req-8d9878b3-be5d-4c2e-8ebf-6ad3e92022a7 req-c8f93362-a2c3-4415-b51c-d1db9c74aecb tempest-ListImageFiltersTestJSON-1710148665 tempest-ListImageFiltersTestJSON-1710148665-project-member] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 781.328951] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 781.329292] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.329406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.330032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.330032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.330032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.330032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.332783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.333030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.333137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.333286] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.597155] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 in Status: SUCCESS [ 781.597410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.668173] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 in Status: SUCCESS [ 781.668173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.668286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.668454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.668641] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.668758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.668828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.669028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.669120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.669207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.669299] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.835700] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.835856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.835925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.836262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.836378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.836627] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.836758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.836828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.837049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.837143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.837259] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 already deleted. [ 781.837575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.071101] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.071443] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.071443] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.071662] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.071919] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.074411] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.075227] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.076746] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.076917] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.077160] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.077275] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.077383] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.077491] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.077598] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.077704] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.077930] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.096021] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.096179] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.098824] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.098824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.098824] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-1c4b8e12-c421-4648-996e-af99beccd80c taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.098824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.098824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.098824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.098824] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c4b8e12-c421-4648-996e-af99beccd80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.128447] env[69847]: INFO networking_nsxv3.common.synchronization [req-c6fbfb2a-717c-4b3d-8cfc-6f008dc4a4e3 req-c3ac66c5-a1d9-46ef-9ce3-755ebe987e24 tempest-FloatingIPsAssociationTestJSON-943086566 tempest-FloatingIPsAssociationTestJSON-943086566-project-member] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 782.128447] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 782.128713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.128897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.130034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.130271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.130470] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.130581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.130647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.130817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.131027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.131135] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.172728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.172901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.172972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.173186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.173369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.173468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.173534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.173683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.173772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.173861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.174018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.174117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.174182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.174327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.174464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.174555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.174616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.174755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.174831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.174912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.174996] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.600248] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.600818] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.600818] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.601028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.601087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.601277] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 1c4b8e12-c421-4648-996e-af99beccd80c not found, creating... [ 782.601610] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.601738] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.601837] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.602101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.602255] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.602815] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.602815] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.602815] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.607186] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.607452] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.607622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 1c4b8e12-c421-4648-996e-af99beccd80c is going to be created. [ 782.632785] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.633052] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.633189] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.633566] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.633841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.634124] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.635060] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.677070] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cf3bdf1-5c54-495f-8312-720bf2e26ee0: rpc.has_security_group_logging(os_id): False [ 782.694425] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.694742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.694808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.695162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.695335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.695668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.695842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.695958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.696203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.696351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.696647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.696817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.696928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.697185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.697358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.697607] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.697771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.697878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.698103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.698247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.698395] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 is going to be created. [ 782.771843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.772059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.772059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.772280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.772696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.800526] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 in Status: IN_PROGRESS for 2s [ 783.137194] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.423527] env[69847]: INFO networking_nsxv3.common.synchronization [req-8d9878b3-be5d-4c2e-8ebf-6ad3e92022a7 req-32ab62cd-d3ea-4b7d-94b4-f23c43c5a63e service nova] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_rules [ 783.423706] env[69847]: INFO networking_nsxv3.common.synchronization [req-8d9878b3-be5d-4c2e-8ebf-6ad3e92022a7 req-32ab62cd-d3ea-4b7d-94b4-f23c43c5a63e service nova] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 783.423840] env[69847]: INFO networking_nsxv3.common.synchronization [req-8d9878b3-be5d-4c2e-8ebf-6ad3e92022a7 req-32ab62cd-d3ea-4b7d-94b4-f23c43c5a63e service nova] Enqueued Resource ID: 1c4b8e12-c421-4648-996e-af99beccd80c with Priority: HIGHEST for action port [ 783.424076] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_rules [ 783.424200] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 783.424288] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c4b8e12-c421-4648-996e-af99beccd80c with Priority: HIGHEST for action port [ 783.426741] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.426741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.426741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.426741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.426741] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.426741] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.426741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.426741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.426741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.426741] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.427202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.427202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.427202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.427202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.427202] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.427843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c4b8e12-c421-4648-996e-af99beccd80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.427941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.428010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.428409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.428409] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c4b8e12-c421-4648-996e-af99beccd80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.640421] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.640734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.640734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.640882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.640966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.641103] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be updated. [ 783.670442] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.673290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.673437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.673715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.674056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.683201] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: IN_PROGRESS for 2s [ 783.870230] env[69847]: INFO networking_nsxv3.common.synchronization [req-cffffdac-f82e-4882-a441-f27ea0dec43a req-0c071f20-c529-43dd-9c4d-68cc8f615fdc tempest-ListImageFiltersTestJSON-1710148665 tempest-ListImageFiltersTestJSON-1710148665-project-member] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 783.871226] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 783.872091] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.872338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.930887] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.931969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.932093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.932290] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c4b8e12-c421-4648-996e-af99beccd80c with status ACTIVE [ 783.934020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.934020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.934020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.934020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.934020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c4b8e12-c421-4648-996e-af99beccd80c is going to be updated. [ 783.956190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.956393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.956446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.956620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.956782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.956904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c4b8e12-c421-4648-996e-af99beccd80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.981217] env[69847]: INFO networking_nsxv3.common.synchronization [req-c20a876f-fd96-4ed7-8da2-064782b692fb req-46ac172b-2a3a-4b99-94d6-3845878624a5 tempest-ListServersNegativeTestJSON-366547923 tempest-ListServersNegativeTestJSON-366547923-project-member] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 783.981704] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 783.982095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.982220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.982267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.982968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.983333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.983492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.983980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.983980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.983980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.983980] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.081147] env[69847]: INFO networking_nsxv3.common.synchronization [req-aac81d51-fa4b-4ad7-9bad-876a2cebb8e8 req-d967e425-f235-4048-8bb3-2db4a2382bc2 tempest-ListServersNegativeTestJSON-366547923 tempest-ListServersNegativeTestJSON-366547923-project-member] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 784.082389] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGHEST for action security_group_members [ 784.082691] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.082801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.247912] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.248187] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.248317] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.248596] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.248889] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.249733] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.249906] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.250522] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.250522] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.250522] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.250659] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.250735] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.250841] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.250950] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.251081] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.251213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.273145] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.273145] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.273145] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.273422] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.274173] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-57d7b222-3c06-4b75-af41-cb7193b330c8 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.274173] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.274173] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.277149] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.277149] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d7b222-3c06-4b75-af41-cb7193b330c8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.440116] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.489987] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.776864] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.777253] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.777253] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.777493] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.777647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.777802] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 57d7b222-3c06-4b75-af41-cb7193b330c8 not found, creating... [ 784.778074] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.778232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.778348] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.778569] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.778711] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.779061] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.779222] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.779337] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.779551] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.779679] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.779817] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 57d7b222-3c06-4b75-af41-cb7193b330c8 is going to be created. [ 784.798479] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.798682] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.798824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.799122] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.799354] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.799575] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.811138] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 in Status: SUCCESS [ 784.811359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.944571] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.944730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.944801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.945051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.945144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.945247] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be created. [ 784.968837] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.969065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.969167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.969417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.969566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.978260] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: UNINITIALIZED for 2s [ 784.991913] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.494817] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.495028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.495142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.495590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.495728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.495836] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 785.529933] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.529933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.529933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.529933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.529933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.537342] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 785.612141] env[69847]: INFO networking_nsxv3.common.synchronization [req-e80a4129-c557-45df-a4e5-d1c005a55a70 req-7daca536-0f25-4d44-8f36-08140270c501 tempest-ImagesNegativeTestJSON-1043089708 tempest-ImagesNegativeTestJSON-1043089708-project-member] Enqueued Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_members [ 785.612141] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGHEST for action security_group_members [ 785.612141] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.612141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.612141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.612141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.612141] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.612141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.612141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.612141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.614654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.614906] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.667947] env[69847]: INFO networking_nsxv3.common.synchronization [req-cffffdac-f82e-4882-a441-f27ea0dec43a req-2ed64a89-13b4-47e7-8618-637f482a11d9 service nova] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_rules [ 785.668127] env[69847]: INFO networking_nsxv3.common.synchronization [req-cffffdac-f82e-4882-a441-f27ea0dec43a req-2ed64a89-13b4-47e7-8618-637f482a11d9 service nova] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 785.668283] env[69847]: INFO networking_nsxv3.common.synchronization [req-cffffdac-f82e-4882-a441-f27ea0dec43a req-2ed64a89-13b4-47e7-8618-637f482a11d9 service nova] Enqueued Resource ID: 57d7b222-3c06-4b75-af41-cb7193b330c8 with Priority: HIGHEST for action port [ 785.668728] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_rules [ 785.668872] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 785.668991] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57d7b222-3c06-4b75-af41-cb7193b330c8 with Priority: HIGHEST for action port [ 785.670188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.670341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.670608] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.670722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.670982] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-57d7b222-3c06-4b75-af41-cb7193b330c8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.671105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.671192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.671957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.671957] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d7b222-3c06-4b75-af41-cb7193b330c8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.692536] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 785.693320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.117804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.117804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.117804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.118547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.118547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.118547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.118547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.118547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.118547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.118744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.118744] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 is going to be updated. [ 786.145369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.145369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.145369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.145594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.145704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.154772] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 in Status: IN_PROGRESS for 2s [ 786.177028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57d7b222-3c06-4b75-af41-cb7193b330c8 with status ACTIVE [ 786.177028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.177028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.177028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.177028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.177028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57d7b222-3c06-4b75-af41-cb7193b330c8 is going to be updated. [ 786.196880] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.197050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.197115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.197310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.197447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.197605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57d7b222-3c06-4b75-af41-cb7193b330c8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.525127] env[69847]: INFO networking_nsxv3.common.synchronization [req-2dd83e92-cc2f-4114-b49a-095a83dc02fe req-c380438b-65a4-4520-ae62-6f0b84231d35 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 786.525656] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 786.525950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.526102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.526167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.526422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.526578] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.526675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.526733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.526880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.526962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.527565] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.987634] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 786.987987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.988275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.988597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.988878] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.989241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.989330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.989540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.989639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.989755] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.992502] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.992671] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.992792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.993095] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.994970] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.994970] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.994970] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.994970] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.994970] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.994970] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.994970] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.994970] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.994970] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.994970] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.994970] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.994970] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.011089] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.011256] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.011398] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.011572] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.011870] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.012087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.012252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.012567] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.012707] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4db671e-71ee-4ee3-b417-d2e0e8bfb461',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.031482] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.031482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.031482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.031701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.031794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.031975] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.032090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.032224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.032302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.032379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.032464] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de already deleted. [ 787.032544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.496651] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.514899] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.515152] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.515339] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.515599] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.515748] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.515901] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port d4db671e-71ee-4ee3-b417-d2e0e8bfb461 not found, creating... [ 787.516203] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.516366] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.516483] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.516698] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.516835] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.517199] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.517292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.517399] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.517602] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.517734] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.517874] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: d4db671e-71ee-4ee3-b417-d2e0e8bfb461 is going to be created. [ 787.537707] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.538172] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.538172] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.538282] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.538566] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.539763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.549133] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 787.549395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.549498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.549700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.549881] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.549992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.550075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.550218] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.550299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.550393] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.999514] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.055228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.055228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.055228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.055228] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be updated. [ 788.088907] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.088907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.088907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.088907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.088907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.097049] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: IN_PROGRESS for 2s [ 788.173061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 in Status: SUCCESS [ 788.173061] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 deletion is rescheduled due to dependency. [ 788.173061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.433833] env[69847]: INFO networking_nsxv3.common.synchronization [req-2dd83e92-cc2f-4114-b49a-095a83dc02fe req-94c2ed12-598b-4e3c-ab37-855db5544e19 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 788.434024] env[69847]: INFO networking_nsxv3.common.synchronization [req-2dd83e92-cc2f-4114-b49a-095a83dc02fe req-94c2ed12-598b-4e3c-ab37-855db5544e19 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 788.434168] env[69847]: INFO networking_nsxv3.common.synchronization [req-2dd83e92-cc2f-4114-b49a-095a83dc02fe req-94c2ed12-598b-4e3c-ab37-855db5544e19 service nova] Enqueued Resource ID: d4db671e-71ee-4ee3-b417-d2e0e8bfb461 with Priority: HIGHEST for action port [ 788.434392] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 788.434524] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 788.434619] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4db671e-71ee-4ee3-b417-d2e0e8bfb461 with Priority: HIGHEST for action port [ 788.435157] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.435280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.435339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.435598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.435679] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.436925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.437062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.437133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.437502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.437502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.437617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.437617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.437748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.437797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.437889] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.438907] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.439057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.439116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.439281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.439359] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4db671e-71ee-4ee3-b417-d2e0e8bfb461',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.501441] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.501746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.501746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.502772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.502772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.502772] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be updated. [ 788.539190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.539342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.539451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.539675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.539823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.548367] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 788.944033] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.944033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.944033] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4db671e-71ee-4ee3-b417-d2e0e8bfb461 with status ACTIVE [ 788.944033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.944033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.944033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.945019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.945256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.945557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.945835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.946034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.948227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.948227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.948227] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4db671e-71ee-4ee3-b417-d2e0e8bfb461 is going to be updated. [ 788.966861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.968597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.968597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.968597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.968597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.968597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4db671e-71ee-4ee3-b417-d2e0e8bfb461" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.443734] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.947184] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.947184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.947184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.947184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.947184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.947184] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be created. [ 789.970645] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.970645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.970645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.970645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.970645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.986311] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: UNINITIALIZED for 2s [ 790.106868] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f in Status: SUCCESS [ 790.107177] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f deletion is rescheduled due to dependency. [ 790.107322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.560453] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 790.560791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.560791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.561074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.561284] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.561401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.561546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.561635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.561710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.561801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.561897] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.562733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.562931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.566085] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.566085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.566085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.566085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.566085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.566085] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.067588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.067588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.068102] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.570701] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.867707] env[69847]: INFO networking_nsxv3.common.synchronization [req-99050357-860d-4d47-a086-c69b6a39c2d6 req-6cf1f800-7ed3-4118-a018-4acc79bd6c99 tempest-ListServerFiltersTestJSON-552165178 tempest-ListServerFiltersTestJSON-552165178-project-member] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 791.868245] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 791.868632] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.869758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.869854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.870061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.870237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.870343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.870406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.870564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.870652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.870748] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.053959] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.053959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.053959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.053959] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.078170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.078504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.078504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.078675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.078791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.078924] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be updated. [ 792.109753] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.109972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.110389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.110389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.110518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.119432] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 792.376021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.555944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.556118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.556188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.556860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.556860] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.556860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.556860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.556860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.557254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.557254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.557254] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.557254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.557384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.557504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.559870] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.559870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.559870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.559870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.559870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.559870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.559870] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.878873] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.060946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 793.082671] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.082966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.082966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.083197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083431] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.083505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.083541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.083762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.083952] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.084058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.084119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.084258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.084330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.084504] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.084592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.084651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.084785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.084858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.084941] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be created. [ 793.149246] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.149246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.149246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.149465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.149575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.159016] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 793.381591] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.381787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.381834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.382028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.382250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.382392] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 793.411607] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.411740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.411804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.412024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.412212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.420875] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 793.901459] env[69847]: INFO networking_nsxv3.common.synchronization [req-19603f8d-53da-4828-9700-0ddd17925724 req-9dc47c1a-d77f-4d47-80ab-31de49f50610 tempest-FloatingIPsAssociationNegativeTestJSON-1675387201 tempest-FloatingIPsAssociationNegativeTestJSON-1675387201-project-member] Enqueued Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_members [ 793.902033] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGHEST for action security_group_members [ 793.902356] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.902482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.902549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.902799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.902953] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.903064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.903127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.903277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.903361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.903452] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.130193] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 794.130193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.130488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.130488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.130648] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.130780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.130923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.131672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.131672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.131672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.131672] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.131672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.131672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.131672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.132038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.132038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.132038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.132148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.132196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.132232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.132340] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.405987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.406158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.406247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.406520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.406623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.406851] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.406975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.411170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.411493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.411493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.411598] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 is going to be updated. [ 794.441624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.441873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.441945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.442170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.442338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.451605] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 in Status: IN_PROGRESS for 2s [ 794.636420] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fa7dd18-0289-4c11-8f13-4837e0914735: rpc.has_security_group_logging(os_id): False [ 794.652909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.652909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.652909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.652909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.652909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.653416] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.653416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.653416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.653560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.653646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.653858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.654014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.654014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.654727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.654936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.654980] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.655080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.655133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.655268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.655376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.655425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be created. [ 794.708714] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.708871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.708944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.709221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.709405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.718997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 795.170527] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 795.170843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.431349] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 795.431349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.005757] env[69847]: INFO networking_nsxv3.common.synchronization [req-2b51d226-9254-4cd7-add0-71ee6f664bc4 req-1133caf8-6c04-40da-8372-f84f8ed3227c tempest-VolumesAdminNegativeTest-613767114 tempest-VolumesAdminNegativeTest-613767114-project-member] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_members [ 796.006313] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_members [ 796.006637] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.006759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.006824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.007096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.007251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.007370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.007433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.007605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.007692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.007780] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.327448] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.327701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.327823] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.328801] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.328801] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.328801] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.328801] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.329065] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.329154] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.329328] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.329445] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.329567] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.329677] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.329796] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.329911] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.330053] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.351503] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.351665] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.351820] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.351998] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.352377] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f707f776-3227-40fa-ad38-0e4d6171d079 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.352572] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.352692] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.352997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.353152] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f707f776-3227-40fa-ad38-0e4d6171d079',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.465131] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 in Status: SUCCESS [ 796.465131] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 deletion is rescheduled due to dependency. [ 796.465131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.511635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.511635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.511635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.511635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.511635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.511968] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.511968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.512117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.512258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.512375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.512517] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 already deleted. [ 796.512641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.731536] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 796.731777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.731913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.732148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.732243] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.856661] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.856881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.857011] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.857314] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.857470] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.857623] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f707f776-3227-40fa-ad38-0e4d6171d079 not found, creating... [ 796.857885] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.858051] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.858168] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.858404] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.858536] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.858802] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.858950] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.859095] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.859335] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.859469] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.859604] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f707f776-3227-40fa-ad38-0e4d6171d079 is going to be created. [ 796.877409] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.877997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.877997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.877997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.878197] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.878386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.236882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.237065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.237148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.237543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.237543] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.237905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.237905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.237905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.238010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.238080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.238167] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.741552] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.741552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.741926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.742170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.742345] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.742457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.742516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.742807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.742901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.742987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.743152] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.743246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.743306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.743451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.743602] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.743694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.743753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.743893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.743972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.744066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.744152] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.827410] env[69847]: INFO networking_nsxv3.common.synchronization [req-2b51d226-9254-4cd7-add0-71ee6f664bc4 req-c5327af1-7a48-4d4a-aa89-45484b558eac service nova] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_rules [ 797.827592] env[69847]: INFO networking_nsxv3.common.synchronization [req-2b51d226-9254-4cd7-add0-71ee6f664bc4 req-c5327af1-7a48-4d4a-aa89-45484b558eac service nova] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_members [ 797.827727] env[69847]: INFO networking_nsxv3.common.synchronization [req-2b51d226-9254-4cd7-add0-71ee6f664bc4 req-c5327af1-7a48-4d4a-aa89-45484b558eac service nova] Enqueued Resource ID: f707f776-3227-40fa-ad38-0e4d6171d079 with Priority: HIGHEST for action port [ 797.827954] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_rules [ 797.828383] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_members [ 797.828383] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f707f776-3227-40fa-ad38-0e4d6171d079 with Priority: HIGHEST for action port [ 797.828701] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.828825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.828890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.829239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.829324] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.830842] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.830956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.831035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.831309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.831405] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.831501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.831571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.831713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.831803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.831889] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.836025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f707f776-3227-40fa-ad38-0e4d6171d079 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.836025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.836025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.836025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.836025] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f707f776-3227-40fa-ad38-0e4d6171d079',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.246821] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fa7dd18-0289-4c11-8f13-4837e0914735: rpc.has_security_group_logging(os_id): False [ 798.264198] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.264344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.264409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.267033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.267033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.267033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.267033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.267642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.267642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.267642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.267642] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be updated. [ 798.324760] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.324906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.324978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.325226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.325379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.331209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.331384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.333718] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.335755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f707f776-3227-40fa-ad38-0e4d6171d079 with status ACTIVE [ 798.335979] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.336176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.336287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.336507] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.336602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.336785] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.337642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.337642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.337642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.337642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.337642] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.337642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.337642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.338136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.338136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.338136] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f707f776-3227-40fa-ad38-0e4d6171d079 is going to be updated. [ 798.346125] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 798.368608] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.368769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.368982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.369093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.369501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.369739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f707f776-3227-40fa-ad38-0e4d6171d079" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.683327] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ee831e-f3d6-42cc-bd81-99f710ec00e7 req-f2e3dc6e-d6a6-4748-b0a5-ccf8573a4d67 tempest-ServerAddressesNegativeTestJSON-1713142195 tempest-ServerAddressesNegativeTestJSON-1713142195-project-member] Enqueued Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_members [ 798.683862] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_members [ 798.684166] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.684413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.684502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.684736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.685108] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.685108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.685493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.685665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.685836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.685836] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.839812] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.049430] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.049743] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-854" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.049904] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-854" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.050303] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-854" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.050605] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.050782] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.050905] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.051516] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.051743] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.052049] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.052238] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.052477] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.053431] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.053431] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.053431] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.053431] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.071392] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.071704] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.071704] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.071875] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-854" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.072219] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.072395] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.072513] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.072882] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.073049] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.188474] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.188733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.188856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.189233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.189368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.189698] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.190150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.190150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.190433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.190575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.190767] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be already deleted. [ 799.190859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.343791] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.343791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.343791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.343791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.343791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.343791] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 is going to be created. [ 799.365773] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.365773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.365773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.365773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.370303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.374772] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: UNINITIALIZED for 2s [ 799.576019] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.576019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.576019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.576190] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.576327] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.576478] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe not found, creating... [ 799.576872] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.577056] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.577252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.577596] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.577747] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.578049] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.578211] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.578328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.578770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.579037] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.579236] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe is going to be created. [ 799.598528] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.598746] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.598856] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.599225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.599528] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.599751] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.359691] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 800.359982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.480991] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ee831e-f3d6-42cc-bd81-99f710ec00e7 req-29c331d3-b1b6-4612-be61-06655ce89fb1 service nova] Enqueued Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_rules [ 800.481507] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ee831e-f3d6-42cc-bd81-99f710ec00e7 req-29c331d3-b1b6-4612-be61-06655ce89fb1 service nova] Enqueued Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_members [ 800.481507] env[69847]: INFO networking_nsxv3.common.synchronization [req-c7ee831e-f3d6-42cc-bd81-99f710ec00e7 req-29c331d3-b1b6-4612-be61-06655ce89fb1 service nova] Enqueued Resource ID: a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe with Priority: HIGHEST for action port [ 800.481936] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_rules [ 800.482540] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_members [ 800.482669] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe with Priority: HIGHEST for action port [ 800.482946] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.483085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.483183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.483410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.483496] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.484341] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.484466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.484510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.484921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.484921] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.484921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.485062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.485108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.485185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.485336] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.485980] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.486959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.487046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.487230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.487267] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.664139] env[69847]: INFO networking_nsxv3.common.synchronization [req-983226e6-2b0d-4a97-a84c-35f67e4f3090 req-3b481f98-1110-4d1e-b119-5d2e7da14c20 tempest-ServersTestJSON-999074606 tempest-ServersTestJSON-999074606-project-member] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_members [ 800.664714] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGHEST for action security_group_members [ 800.665408] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.665565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.665637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.665846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.666040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.666107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.666169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.666317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.666412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.666589] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.993091] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.993091] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.993091] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe with status ACTIVE [ 800.993091] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.993091] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.993091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.993737] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.994271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.995447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.995447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.995447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.995946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe is going to be updated. [ 801.019146] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.019146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.019146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.019146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.019146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.019146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5cbe802-2eb5-47a5-b3a6-465c52ee1dfe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.168328] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.169085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.169085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.169085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.169085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.169085] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.169320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.169320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.169419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.169518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.169606] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 is going to be updated. [ 801.195205] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.195451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.195451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.195568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.195666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.203996] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 in Status: IN_PROGRESS for 2s [ 801.386047] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: SUCCESS [ 801.386047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.386047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.386396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.386396] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.386480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.386585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.386673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.386750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.386827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.386912] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.498843] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.731029] env[69847]: INFO networking_nsxv3.common.synchronization [req-51c11695-4d66-42b8-b438-6994ce5cf2b8 req-480e109c-7d65-4ae4-8979-ed124ace675e tempest-DeleteServersAdminTestJSON-2145681394 tempest-DeleteServersAdminTestJSON-2145681394-project-member] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 801.731029] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 801.731029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.731029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.731029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.731029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.731029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.731029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.731029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.732342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.732342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.732342] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.890538] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.003810] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.005045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.005258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.005551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.005735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.005968] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be is going to be created. [ 802.030217] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.030356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.030418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.030692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.030789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.039985] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be in Status: UNINITIALIZED for 2s [ 802.075406] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.075611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.075736] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.076135] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.076315] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.076468] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.076584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.076834] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.077008] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.077761] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.077891] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.078015] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.078269] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.078395] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.078533] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.078721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.099259] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.099425] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 802.099563] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.099726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.100517] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-69942063-e735-4eaa-84e8-40bb45e25a77 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.100517] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.100517] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.100729] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.100810] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69942063-e735-4eaa-84e8-40bb45e25a77',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.236311] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.236478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.236553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.236776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.236915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.237089] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.237185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.237263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.237397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.237466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.237559] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be updated. [ 802.270314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.270410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.270457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.270633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.270775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.280083] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: IN_PROGRESS for 2s [ 802.392836] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39c88011-49df-4c92-a73f-ef1e67d3d9e4: rpc.has_security_group_logging(os_id): False [ 802.409800] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.410057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.410057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.410232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.410328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.410562] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.410658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.410718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.410873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.410950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.411051] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 is going to be created. [ 802.467789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.467789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.467789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.467789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.467789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.481113] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: IN_PROGRESS for 2s [ 802.604154] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.604433] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.604602] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.604910] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.605161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.605303] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 69942063-e735-4eaa-84e8-40bb45e25a77 not found, creating... [ 802.605597] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.605848] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.606128] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606281] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606673] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.606867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.607041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.607241] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.607507] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.607578] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 69942063-e735-4eaa-84e8-40bb45e25a77 is going to be created. [ 802.633639] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.633837] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.633957] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.634379] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.634450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.634645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.223849] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 in Status: SUCCESS [ 803.223849] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 deletion is rescheduled due to dependency. [ 803.224074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.387422] env[69847]: INFO networking_nsxv3.common.synchronization [req-51c11695-4d66-42b8-b438-6994ce5cf2b8 req-0f6816aa-3463-4468-9020-fb783965606f service nova] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_rules [ 803.387743] env[69847]: INFO networking_nsxv3.common.synchronization [req-51c11695-4d66-42b8-b438-6994ce5cf2b8 req-0f6816aa-3463-4468-9020-fb783965606f service nova] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 803.387743] env[69847]: INFO networking_nsxv3.common.synchronization [req-51c11695-4d66-42b8-b438-6994ce5cf2b8 req-0f6816aa-3463-4468-9020-fb783965606f service nova] Enqueued Resource ID: 69942063-e735-4eaa-84e8-40bb45e25a77 with Priority: HIGHEST for action port [ 803.387919] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_rules [ 803.387979] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 803.388090] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69942063-e735-4eaa-84e8-40bb45e25a77 with Priority: HIGHEST for action port [ 803.388654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.388818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.388868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.389047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.389157] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.389933] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.390035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.390220] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-69942063-e735-4eaa-84e8-40bb45e25a77 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.390540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.390620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.390794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.390869] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69942063-e735-4eaa-84e8-40bb45e25a77',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.894520] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.894520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.894887] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69942063-e735-4eaa-84e8-40bb45e25a77 with status ACTIVE [ 803.894887] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.894887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.894887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.895102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.895267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.895444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.895546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.896289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.896289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.896289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.896289] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.896289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.896289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.896289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.896535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.896535] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69942063-e735-4eaa-84e8-40bb45e25a77 is going to be updated. [ 803.916073] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.916226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.916299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.916509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.916647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.916803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69942063-e735-4eaa-84e8-40bb45e25a77" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.052405] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be in Status: SUCCESS [ 804.052700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.053332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.053332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.053332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.053493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.053604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.053798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.053913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.054042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.054163] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.293972] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 804.294629] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 deletion is rescheduled due to dependency. [ 804.294629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.294629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.294629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.294902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.294902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.295043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.295126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.295208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.295297] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.492527] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: SUCCESS [ 804.493378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.556574] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.556788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.556914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.557212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.557423] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.557552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.557635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.557878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.558164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.558164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.558311] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.558408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.558482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.558660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.558854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.558961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.559630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.560896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.560896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.560896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.560896] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.797866] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.062724] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de342dad-fb8d-4c7b-87ea-595f01e3c6be: rpc.has_security_group_logging(os_id): False [ 805.080322] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.080457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.080534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.080769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.080859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.081121] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.081229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.081229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.081406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.081503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.081674] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.081811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.081811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.081998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.081998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.082201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.082323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.082403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.082583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.082710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.082815] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be is going to be created. [ 805.141138] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.141320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.141448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.141728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.142045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.152087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be in Status: IN_PROGRESS for 2s [ 805.302120] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.805567] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.805724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.805795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.806048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.806131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.806217] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be updated. [ 805.835890] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.835890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.836141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.836200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.836834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.844389] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: IN_PROGRESS for 2s [ 806.409867] env[69847]: INFO networking_nsxv3.common.synchronization [req-3024ebbd-1a34-4ad1-a21c-21a468fba061 req-e6e5818e-f487-4c9c-89b3-56315c286454 tempest-ServersAdminNegativeTestJSON-26222337 tempest-ServersAdminNegativeTestJSON-26222337-project-member] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 806.414819] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGHEST for action security_group_members [ 806.415517] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.415671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.415752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.415989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.416211] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.416336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.416412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.416605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.416714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.416818] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.445191] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed157674-cf9d-4f87-acab-552690cd2376 req-caaca08c-604a-4b3e-9c68-47e012c44643 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 806.445842] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 806.446460] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.447064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.447064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.447257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.447419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.447517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.447576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.447725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.447807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.447897] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.866830] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.867175] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.867322] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.867650] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.867942] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.868081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.868181] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.868711] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.868711] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.868855] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.868890] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.869045] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.869191] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.869321] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.869499] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.869549] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.893524] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.893624] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.893717] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.893949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.894295] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f905b704-36d8-417f-90fa-6171386286fd taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.894496] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.895109] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.895109] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895266] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f905b704-36d8-417f-90fa-6171386286fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.926553] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.926553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.926792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.926831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.927522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.927522] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.927522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.927522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.927855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.927855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.927924] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be updated. [ 806.953170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.953318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.953392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.953609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.953751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.954903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.955110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.955234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.955438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.955569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.955799] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.956078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.956180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.956360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.956473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.956591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 already deleted. [ 806.956697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.963641] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: IN_PROGRESS for 2s [ 807.164023] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be in Status: SUCCESS [ 807.164023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.397218] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.397435] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.397557] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.399020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.399020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.399020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f905b704-36d8-417f-90fa-6171386286fd not found, creating... [ 807.399020] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.399020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.399020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.399020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.399020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.399556] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.399556] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.399639] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.399810] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.399930] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.405149] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f905b704-36d8-417f-90fa-6171386286fd is going to be created. [ 807.421353] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.421768] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.421768] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.422063] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.422192] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.422444] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.855480] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 807.855791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.856049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.856353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.856616] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.856777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.856878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.857117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.857260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.857363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.857499] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.250530] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed157674-cf9d-4f87-acab-552690cd2376 req-47ebccb8-3bba-472d-ba6b-42a9beca5740 service nova] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 808.250703] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed157674-cf9d-4f87-acab-552690cd2376 req-47ebccb8-3bba-472d-ba6b-42a9beca5740 service nova] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 808.250839] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed157674-cf9d-4f87-acab-552690cd2376 req-47ebccb8-3bba-472d-ba6b-42a9beca5740 service nova] Enqueued Resource ID: f905b704-36d8-417f-90fa-6171386286fd with Priority: HIGHEST for action port [ 808.251119] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 808.251276] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 808.251460] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f905b704-36d8-417f-90fa-6171386286fd with Priority: HIGHEST for action port [ 808.254883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.255083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.255163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.255464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.255558] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.257510] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.257510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.257510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.257510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.259960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.260060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.260290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.260290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.260361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.261367] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.261684] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f905b704-36d8-417f-90fa-6171386286fd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.262528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.262528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.262528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.262640] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f905b704-36d8-417f-90fa-6171386286fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.364300] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.364476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.364543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.364748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.364916] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.365029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.365094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.365248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.365339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.365429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.365637] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.365697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.365729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.365849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.365983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.366084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.366143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.366278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.366354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.366437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.366514] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.626019] env[69847]: INFO networking_nsxv3.common.synchronization [req-7051a018-fc7f-4cc0-9396-b78b598a3423 req-4ce72499-369f-4d96-9288-6c4d80b51f68 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 808.630250] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 808.630250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.630250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.630250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.630250] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.765089] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.765244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.765461] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.768331] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f905b704-36d8-417f-90fa-6171386286fd with status ACTIVE [ 808.768570] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.768805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.768805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.769074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.770682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.771218] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.771218] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.771218] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.771489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.771627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.771755] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.771884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.772051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.772171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.772275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.772405] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f905b704-36d8-417f-90fa-6171386286fd is going to be updated. [ 808.795088] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.795255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.795392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.795506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.795639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.795858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.873347] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8022d569-fc48-4639-a726-38e4b078eac1: rpc.has_security_group_logging(os_id): False [ 808.891923] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.892184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.892184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.892382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.892484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.893023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.893023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.893023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.893023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.893483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.893483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.893483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.893483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.893704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.893704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.893823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.893924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.893924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.894165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.894165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.894326] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be updated. [ 808.976828] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1f264c4-f165-4427-b9e3-23d05179073b in Status: SUCCESS [ 808.976828] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1f264c4-f165-4427-b9e3-23d05179073b deletion is rescheduled due to dependency. [ 808.976828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.986967] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.986967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.986967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.986967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.986967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.002305] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: IN_PROGRESS for 2s [ 809.130150] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.130315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.130378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.134035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.134035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.134035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.134035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.134035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.134035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.134035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.134035] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 809.162799] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.162962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.163044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.163257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.163400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.172588] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 809.275669] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.357161] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.357161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.357161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.357161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.357161] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.357161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.357161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.357740] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.358016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.358326] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.358761] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.358961] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.359208] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.359443] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.359646] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.359997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.380336] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.380336] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.380336] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.380336] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.380336] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-73c9e726-b62b-487a-97bc-a369f3e0a3f6 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.380336] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.380336] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.381582] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.381950] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c9e726-b62b-487a-97bc-a369f3e0a3f6',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.785393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.785393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.785393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.785393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.785393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.785393] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be created. [ 809.809419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.809419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.809419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.809419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.809419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.816909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: UNINITIALIZED for 2s [ 809.885164] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.885387] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.885509] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.885788] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.885942] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.886108] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 73c9e726-b62b-487a-97bc-a369f3e0a3f6 not found, creating... [ 809.886366] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.886555] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.886677] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.886898] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.887052] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.887340] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.887496] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.887611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.887821] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.888276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.888432] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 73c9e726-b62b-487a-97bc-a369f3e0a3f6 is going to be created. [ 809.907477] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.907681] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.907803] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.908082] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.908318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.908541] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.611310] env[69847]: INFO networking_nsxv3.common.synchronization [req-7051a018-fc7f-4cc0-9396-b78b598a3423 req-cc46db70-18b8-4b32-9463-afb94a3ae567 service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 810.611520] env[69847]: INFO networking_nsxv3.common.synchronization [req-7051a018-fc7f-4cc0-9396-b78b598a3423 req-cc46db70-18b8-4b32-9463-afb94a3ae567 service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 810.611657] env[69847]: INFO networking_nsxv3.common.synchronization [req-7051a018-fc7f-4cc0-9396-b78b598a3423 req-cc46db70-18b8-4b32-9463-afb94a3ae567 service nova] Enqueued Resource ID: 73c9e726-b62b-487a-97bc-a369f3e0a3f6 with Priority: HIGHEST for action port [ 810.611898] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 810.612051] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 810.612154] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c9e726-b62b-487a-97bc-a369f3e0a3f6 with Priority: HIGHEST for action port [ 810.612902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.613300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.613455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.613766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.613846] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.615164] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.615254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.615505] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c9e726-b62b-487a-97bc-a369f3e0a3f6 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.615640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.615727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.615911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.616027] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c9e726-b62b-487a-97bc-a369f3e0a3f6',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.889812] env[69847]: INFO networking_nsxv3.common.synchronization [req-46959bc5-2aca-4146-a736-aa995142fc5b req-cff38eea-14dc-4173-88f7-3633a684a5bf tempest-ServerAddressesNegativeTestJSON-1713142195 tempest-ServerAddressesNegativeTestJSON-1713142195-project-member] Enqueued Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_members [ 810.890556] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGHEST for action security_group_members [ 810.890862] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.890985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.891065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.891257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.891584] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.891730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.891797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.892025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.892154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.892262] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.016087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 811.019165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.117737] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.117902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.118153] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73c9e726-b62b-487a-97bc-a369f3e0a3f6 with status ACTIVE [ 811.118317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.118426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.118490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.118737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.118837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.119008] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.119110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.119223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.119433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.119530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.119765] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.119894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.119940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.120106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.120184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.120272] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73c9e726-b62b-487a-97bc-a369f3e0a3f6 is going to be updated. [ 811.141830] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.141934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.141970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.142201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.142506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.142702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c9e726-b62b-487a-97bc-a369f3e0a3f6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.182522] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 811.182703] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe deletion is rescheduled due to dependency. [ 811.182814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.182970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.183269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.183447] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.183560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.183684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.183793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.183870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.183967] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.395713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.395955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.396186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.396378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.396525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.396816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.396970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.397302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.397302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.397431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.397564] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be is going to be updated. [ 811.424601] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.424776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.424835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.425926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.425926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.434140] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be in Status: IN_PROGRESS for 2s [ 811.687348] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.826787] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 811.827073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.827192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.827412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.827596] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.827709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.827949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.827949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.828125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.828125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.828232] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.971223] env[69847]: INFO networking_nsxv3.common.synchronization [req-af7c8867-59db-4c18-a805-019eb829b213 req-41a90cfc-9cb4-4946-9baf-73c6dbb8246d tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 811.971815] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 811.972154] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.972309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.972400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.972725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.972882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.973038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.973108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.973262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.973356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.973452] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.191041] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.330694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.330851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.330924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.331173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.331365] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.331470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.331535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.331695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.331784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.331872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.332325] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.332325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.332325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.332325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.332551] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.332599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.332634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.332759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.332838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.332918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.333013] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.400458] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.400673] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.400810] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.401139] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.401922] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.402124] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.402257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.402537] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.402708] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.402920] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.403081] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.403203] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.403348] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.403504] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.403595] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.403942] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.424076] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.424076] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.424076] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.424076] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.424939] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-eb9f18a7-7066-4e6b-980f-933c9627f490 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.425647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.425899] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.426591] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.428112] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb9f18a7-7066-4e6b-980f-933c9627f490',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.478731] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.478996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.478996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.479242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.479466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.479566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.479678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.479731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.479866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.479937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.480034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 already deleted. [ 812.480114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.693988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.694291] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.694418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.694726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.695014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.695148] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 812.720981] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.721166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.721238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.721655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.721721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.731792] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 812.837534] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88aae7-5837-4451-89b6-8972ab00f699: rpc.has_security_group_logging(os_id): False [ 812.854935] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.855098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.855210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.855374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.855464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.855641] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.855739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.855807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.855947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.856038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.856222] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.856315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.856400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.856513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.856575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.856763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.856845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.856905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.857066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.857163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.857250] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be created. [ 812.912661] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.912904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.912992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.913235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.913468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.923847] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 812.933186] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.933506] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.933852] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.934288] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.934474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.934642] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port eb9f18a7-7066-4e6b-980f-933c9627f490 not found, creating... [ 812.934918] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.935102] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.935220] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.935462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.935607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.935907] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.936076] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.936191] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.936403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.936538] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.936672] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: eb9f18a7-7066-4e6b-980f-933c9627f490 is going to be created. [ 812.955287] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.955500] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.955715] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.955867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.956126] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.956764] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.445275] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be in Status: SUCCESS [ 813.445517] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be deletion is rescheduled due to dependency. [ 813.445652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.714806] env[69847]: INFO networking_nsxv3.common.synchronization [req-af7c8867-59db-4c18-a805-019eb829b213 req-c8f50e8c-9cf4-4fb9-9e5b-5f95c1beb557 service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 813.714992] env[69847]: INFO networking_nsxv3.common.synchronization [req-af7c8867-59db-4c18-a805-019eb829b213 req-c8f50e8c-9cf4-4fb9-9e5b-5f95c1beb557 service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 813.715145] env[69847]: INFO networking_nsxv3.common.synchronization [req-af7c8867-59db-4c18-a805-019eb829b213 req-c8f50e8c-9cf4-4fb9-9e5b-5f95c1beb557 service nova] Enqueued Resource ID: eb9f18a7-7066-4e6b-980f-933c9627f490 with Priority: HIGHEST for action port [ 813.715376] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 813.715506] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 813.715604] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb9f18a7-7066-4e6b-980f-933c9627f490 with Priority: HIGHEST for action port [ 813.716170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.716365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.716365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.716625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.716674] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.717954] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.718097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.718169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.718349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.718502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.718598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.718662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.718803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.718888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.718979] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.719806] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb9f18a7-7066-4e6b-980f-933c9627f490 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.719919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.719961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.720107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.720202] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb9f18a7-7066-4e6b-980f-933c9627f490',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.222374] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.222576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.227862] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.229066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb9f18a7-7066-4e6b-980f-933c9627f490 with status ACTIVE [ 814.229066] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.229208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.229208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.229412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.229508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.229691] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.229795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.229843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.229996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.230088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.230266] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.230361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.230426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.230565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.230640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.230724] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb9f18a7-7066-4e6b-980f-933c9627f490 is going to be updated. [ 814.254333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.254475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.254531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.254734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.254949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.255045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb9f18a7-7066-4e6b-980f-933c9627f490" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.738023] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.746282] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 814.746515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.746681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.746906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.747107] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.747256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.747287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.747430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.747515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.747616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.747690] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.942711] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 814.943237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.239109] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.239373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.239425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.239702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.239816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.239943] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be created. [ 815.254302] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.254493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.254621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.254869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.255112] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.255226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.255298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.255458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.255592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.255686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.255837] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.255931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.255992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.256158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.256298] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.256416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.256483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.256775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.256775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.256878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.256988] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.261994] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.261994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.262107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.262258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.262511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.271134] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: UNINITIALIZED for 2s [ 815.759442] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b495386a-9f65-4bd6-a72b-2cc4c5b333fe: rpc.has_security_group_logging(os_id): False [ 815.777244] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.777404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.777449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.777659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.777755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.777968] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.778083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.778143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.778289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.778366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.778543] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.778624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.778691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.778820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.778894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.779108] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.779200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.779275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.779491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.779575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.779662] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 815.847230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.847376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.847436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.847743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.847920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.861995] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 816.091446] env[69847]: INFO networking_nsxv3.common.synchronization [req-1cb72225-7be0-49da-babb-60b07fb0af66 req-b27df63d-c2a2-477d-90c4-eeff0be2f441 tempest-FloatingIPsAssociationTestJSON-943086566 tempest-FloatingIPsAssociationTestJSON-943086566-project-member] Enqueued Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 816.092157] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 with Priority: HIGHEST for action security_group_members [ 816.092498] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-538bdf43-fa07-48d1-906e-f7fa68a3a739 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.092659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.092756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.093012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.093180] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.093284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.093343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.093539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.093672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.093822] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538bdf43-fa07-48d1-906e-f7fa68a3a739',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.596054] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.596054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.596054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.596279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.596279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.596584] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.596711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.596795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.596979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.597102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.597213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 is going to be updated. [ 816.623663] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.623929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.624183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.624432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.624645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.633605] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: IN_PROGRESS for 2s [ 817.281668] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 817.282239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.282239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.282398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.282503] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.282641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.282704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.282873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.282959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.283054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.283143] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.785608] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.785746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.785829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.786091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.786265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.786366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.786455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.786587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.786678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.786767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.786914] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.787015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.787081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.787252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.787357] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.787478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.787543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.787849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.787849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.787849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.788024] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.878044] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 817.878044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.239301] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 818.239513] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 818.240521] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 818.240521] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 818.240521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.240521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.240752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.240840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.240993] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.241194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.241260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.241504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.241600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.241692] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.242875] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.242989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.243067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.243234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.243402] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.243500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.243564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.243711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.243790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.243872] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.292028] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 818.292028] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 818.292028] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_rules [ 818.292028] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 818.292028] env[69847]: INFO networking_nsxv3.common.synchronization [req-57625353-acdd-4225-91c8-20a51c5b4f8e req-91dcd64d-d3f4-4944-b885-3976cece24df tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: f905b704-36d8-417f-90fa-6171386286fd with Priority: HIGHEST for action port [ 818.296021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 818.296021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_rules [ 818.296021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f905b704-36d8-417f-90fa-6171386286fd with Priority: HIGHEST for action port [ 818.296021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 818.296021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 818.296021] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 447511d4-51f2-4b25-94d1-cdabf552a536: rpc.has_security_group_logging(os_id): False [ 818.296021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.296021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.296021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.296021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.296021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.300290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.300290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.300290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.300290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.300290] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.300857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f905b704-36d8-417f-90fa-6171386286fd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.300963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.301073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.301225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.301292] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f905b704-36d8-417f-90fa-6171386286fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.302280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.302410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.302559] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.302635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.319096] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.319241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.319304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.319513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.319605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.319811] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.319938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.319994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.320139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.320217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.320390] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.320484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.320543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.320687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.320769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.320945] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.321050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.321330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.321516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.321598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.321686] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be created. [ 818.393057] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.393170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.393251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.393473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.393707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.408204] env[69847]: INFO networking_nsxv3.common.synchronization [req-9997250f-8437-47e8-895d-5e93e740b731 req-ba37d958-8de6-4e57-bf5e-2a992fb069f4 tempest-DeleteServersAdminTestJSON-2145681394 tempest-DeleteServersAdminTestJSON-2145681394-project-member] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 818.408204] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 818.408627] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGHEST for action security_group_members [ 818.408967] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.409149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.409220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.409536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.411169] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.411169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.411169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.411169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.411169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.411169] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.643099] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 in Status: SUCCESS [ 818.643271] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538bdf43-fa07-48d1-906e-f7fa68a3a739 deletion is rescheduled due to dependency. [ 818.643381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538bdf43-fa07-48d1-906e-f7fa68a3a739" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.748764] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.749619] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.801171] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.801171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.803864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.804086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.804263] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f905b704-36d8-417f-90fa-6171386286fd with status ACTIVE [ 818.806919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.806919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.806919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.806919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.806919] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f905b704-36d8-417f-90fa-6171386286fd is going to be updated. [ 818.826849] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.826973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.826973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.827224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.827375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.827561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.918728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.918932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.919020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.919292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.919417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.919800] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.919800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.919887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.920034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.920129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.920215] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be updated. [ 818.957118] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.957118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.957118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.957118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.957118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.968729] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: IN_PROGRESS for 2s [ 818.987401] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_members [ 818.987401] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 818.987401] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 818.989658] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_members [ 818.989658] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 818.989658] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 818.989658] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.989658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.989658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.990055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.990249] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.990405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.990518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.990622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.990768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.990987] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.992461] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.992603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.992871] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.993086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.056741] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 819.056921] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 819.057068] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_rules [ 819.057655] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 819.057655] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_rules [ 819.057655] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_members [ 819.057655] env[69847]: INFO networking_nsxv3.common.synchronization [req-d02d14ad-30db-4dab-bd1c-9d650c6c3cde req-56db751d-687a-4558-a299-fb9d82295ecd tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: f905b704-36d8-417f-90fa-6171386286fd with Priority: HIGHEST for action port [ 819.058453] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 819.058453] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_rules [ 819.058453] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_members [ 819.058560] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f905b704-36d8-417f-90fa-6171386286fd with Priority: HIGHEST for action port [ 819.058640] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_rules [ 819.058869] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 819.058869] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 819.059098] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.059208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.059433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.059524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.059712] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.059780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.059949] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f905b704-36d8-417f-90fa-6171386286fd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.060058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.060123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.060315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.060397] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f905b704-36d8-417f-90fa-6171386286fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.061488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.061607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.061676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.061966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.062060] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.062781] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.062916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.063069] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.063150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.250997] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.254118] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.495994] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.564075] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f905b704-36d8-417f-90fa-6171386286fd with status ACTIVE [ 819.564317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.564453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.564523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.564729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.564825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.564999] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.565133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.565224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.565389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.565466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.565649] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.565739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.565799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.565949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.566036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.566110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f905b704-36d8-417f-90fa-6171386286fd is going to be updated. [ 819.568146] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.568272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.586145] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.586285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.586372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.586527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.586676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.586832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f905b704-36d8-417f-90fa-6171386286fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.753494] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.753494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.753494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.754343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.754343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.754343] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 819.758379] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.758544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.758644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.758905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.758996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.759127] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be created. [ 819.780305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.780999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.781095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.781309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.781570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.783316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.783466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.783557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.783758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.784092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.793388] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 819.794098] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: UNINITIALIZED for 2s [ 819.997737] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.420941] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 820.421135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.499912] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.500305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.500305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.500481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.500518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.500832] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 is going to be created. [ 820.526146] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.526146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.526146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.526463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.526515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.535409] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: UNINITIALIZED for 2s [ 820.979834] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8022d569-fc48-4639-a726-38e4b078eac1 in Status: SUCCESS [ 820.980078] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 deletion is rescheduled due to dependency. [ 820.980150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.769237] env[69847]: INFO networking_nsxv3.common.synchronization [req-3799f948-f65f-4b0c-a183-858b2bae5afe req-e70ea933-1618-4953-b4eb-5d9bb8cfd785 tempest-ServerDiagnosticsTest-1332920507 tempest-ServerDiagnosticsTest-1332920507-project-member] Enqueued Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_members [ 821.769237] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_members [ 821.769237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.769237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.769237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.770333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.770693] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.770994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.771175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.772605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.772605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.772605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.822023] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 821.822566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.823489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 821.823663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.823837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.824055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.824476] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.824476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.824476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.824860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.824963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.825217] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.826380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.826725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.826889] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.827067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.827067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.827209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.827286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.827482] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.278534] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.278691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.279839] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.279839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.280425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c already deleted. [ 822.280425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.329047] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.333578] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.410128] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.410318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.410440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.410699] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.411329] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.411329] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.411329] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.411546] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.411645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.411781] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.411892] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.411999] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.412117] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.412227] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.412327] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.412478] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.431988] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.432498] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.432498] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.432884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.433246] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-5c571c47-0918-4b68-840b-5233bce514ab taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.433426] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.433550] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.433947] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.434177] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c571c47-0918-4b68-840b-5233bce514ab',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.544481] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: SUCCESS [ 822.544709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.545656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.545656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.545656] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.545952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.545952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.545952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.546057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.546100] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.836434] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.837484] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.936827] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.937106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.937447] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.937655] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.937655] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.937892] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 5c571c47-0918-4b68-840b-5233bce514ab not found, creating... [ 822.938155] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.939166] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.939166] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.941397] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.941533] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.941876] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.942054] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.942175] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.942421] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.942582] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.942721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 5c571c47-0918-4b68-840b-5233bce514ab is going to be created. [ 822.961119] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.961340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.961459] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.961744] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.961973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.962208] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.048803] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.339435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.339611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.339664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.339916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.340030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.340138] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be updated. [ 823.341432] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.341565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.341620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.341799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.341884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.341973] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 823.367108] env[69847]: INFO networking_nsxv3.common.synchronization [None req-1daebf48-4415-4618-9c4c-22568dd7b7c1 None None] Enqueued Resource ID: b6727aae-c7c5-4989-9e65-9aceaa5cf4b8 with Priority: HIGHEST for action port [ 823.367377] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6727aae-c7c5-4989-9e65-9aceaa5cf4b8 with Priority: HIGHEST for action port [ 823.373401] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6727aae-c7c5-4989-9e65-9aceaa5cf4b8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.373656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6727aae-c7c5-4989-9e65-9aceaa5cf4b8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.373656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6727aae-c7c5-4989-9e65-9aceaa5cf4b8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.373971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6727aae-c7c5-4989-9e65-9aceaa5cf4b8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.374229] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6727aae-c7c5-4989-9e65-9aceaa5cf4b8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.382221] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.382386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.382437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.382635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.382797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.385560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.385687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.385762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.385911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.386050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.408134] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 823.408922] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 823.552039] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.876979] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6727aae-c7c5-4989-9e65-9aceaa5cf4b8 [ 823.877240] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.877297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.877474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.877571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.877661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.877749] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6727aae-c7c5-4989-9e65-9aceaa5cf4b8 already deleted. [ 823.877824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6727aae-c7c5-4989-9e65-9aceaa5cf4b8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.054923] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.055111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.055186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.055396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.055728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.055728] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 is going to be updated. [ 824.063939] env[69847]: INFO networking_nsxv3.common.synchronization [req-3799f948-f65f-4b0c-a183-858b2bae5afe req-a0de55ae-3c0b-4541-83a6-9f5689af5803 service nova] Enqueued Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_rules [ 824.063939] env[69847]: INFO networking_nsxv3.common.synchronization [req-3799f948-f65f-4b0c-a183-858b2bae5afe req-a0de55ae-3c0b-4541-83a6-9f5689af5803 service nova] Enqueued Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_members [ 824.063939] env[69847]: INFO networking_nsxv3.common.synchronization [req-3799f948-f65f-4b0c-a183-858b2bae5afe req-a0de55ae-3c0b-4541-83a6-9f5689af5803 service nova] Enqueued Resource ID: 5c571c47-0918-4b68-840b-5233bce514ab with Priority: HIGHEST for action port [ 824.063939] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_rules [ 824.063939] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_members [ 824.063939] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c571c47-0918-4b68-840b-5233bce514ab with Priority: HIGHEST for action port [ 824.063939] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.064938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.065076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.065728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.065728] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.068494] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.068628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.069121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.069121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.069121] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.069121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.070419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.070419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.070419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.070419] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.070419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c571c47-0918-4b68-840b-5233bce514ab taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.070419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.071145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.071145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.071145] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c571c47-0918-4b68-840b-5233bce514ab',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.086706] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.086706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.086706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.086706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.086706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.096150] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: IN_PROGRESS for 2s [ 824.569521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.569836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.572090] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.573417] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c571c47-0918-4b68-840b-5233bce514ab with status ACTIVE [ 824.573417] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.573417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.573417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.573748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.573748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.573903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.573983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.573983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.574135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.574213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.574397] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.574479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.574531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.574677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.574752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.574835] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c571c47-0918-4b68-840b-5233bce514ab is going to be updated. [ 824.609879] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.610099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.610099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.610300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.610443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.610606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c571c47-0918-4b68-840b-5233bce514ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.081216] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.352236] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e758281b-f1c7-4089-96b4-3047c7e0c0f5 None None] Enqueued Resource ID: c9d19617-8b3a-4ab6-b85b-7ad145376b54 with Priority: HIGHEST for action port [ 825.352781] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9d19617-8b3a-4ab6-b85b-7ad145376b54 with Priority: HIGHEST for action port [ 825.353144] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9d19617-8b3a-4ab6-b85b-7ad145376b54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.353300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9d19617-8b3a-4ab6-b85b-7ad145376b54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.353394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9d19617-8b3a-4ab6-b85b-7ad145376b54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.353671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9d19617-8b3a-4ab6-b85b-7ad145376b54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.353802] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9d19617-8b3a-4ab6-b85b-7ad145376b54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.419790] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 825.420023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.421273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.421533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.421746] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.421891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.421949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.422127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.422212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.422301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.422396] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.426293] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 825.426476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.426642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.426846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.427064] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.427197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.427240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.427741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.427741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.427741] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.428260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.432021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.432021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.432021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.432021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.432021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.585370] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.585370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.585370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.585370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.585370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.585370] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c is going to be created. [ 825.611751] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.611751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.611924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.612121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.612326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.621799] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c in Status: UNINITIALIZED for 2s [ 825.856161] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9d19617-8b3a-4ab6-b85b-7ad145376b54 [ 825.856401] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.857153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.857153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.857153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.857153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.857153] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9d19617-8b3a-4ab6-b85b-7ad145376b54 already deleted. [ 825.857153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9d19617-8b3a-4ab6-b85b-7ad145376b54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.931826] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.933286] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.937022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.937022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.937022] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.107805] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: SUCCESS [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.112020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.112020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.112020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.435416] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.437578] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 804e0265-2d3b-49e8-899e-80d4d047aae0: rpc.has_security_group_logging(os_id): False [ 826.439231] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.458920] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.459071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.459202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.459334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.459457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.459722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.459799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.459844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.459992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.460119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.460172] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be created. [ 826.536520] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.536660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.536725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.536932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.537118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.547950] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 826.614201] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.943677] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.943677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.943677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.943677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.943677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.943677] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be updated. [ 826.946198] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.946198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.946198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.948117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.948253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.948376] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 826.978213] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.978361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.978430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.978635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.980563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.980563] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.980955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.980955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.980955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.980955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.995166] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 826.998063] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 827.052100] env[69847]: INFO networking_nsxv3.common.synchronization [req-7163715c-f26d-4a48-9ce2-1735894d6fd9 req-986d2140-f0ea-4623-8a0c-f5ffb7b38345 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 827.053257] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 827.053573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.053726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.053829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.054121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.055137] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.055308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.055510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.055587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.055663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.055737] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.116717] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f78c8839-8143-4fa9-8d9a-46b39052b3a4: rpc.has_security_group_logging(os_id): False [ 827.133809] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.134088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.134198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.134440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.134643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.134926] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.135098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.135170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.137567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.137567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.137567] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 is going to be created. [ 827.188117] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.188311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.188353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.188630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.188814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.200141] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: IN_PROGRESS for 2s [ 827.562940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.562940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.562940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.562940] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 827.590754] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.590904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.590947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.591181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.591386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.600090] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 827.629881] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c in Status: SUCCESS [ 827.629995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.630156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.630368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.630609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.630711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.630747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.630897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.630959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.631036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.631157] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.688023] env[69847]: INFO networking_nsxv3.common.synchronization [req-a5350b4e-d91c-4661-8241-455a6aa1595f req-98520204-cf34-431a-8d47-dadf435d5cb2 tempest-ServersWithSpecificFlavorTestJSON-1036324866 tempest-ServersWithSpecificFlavorTestJSON-1036324866-project-member] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 827.688023] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 827.688023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.688023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.688023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.688023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.688947] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.689288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.689436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.689678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.689879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.690120] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.080758] env[69847]: INFO networking_nsxv3.common.synchronization [req-f55c18d3-fa1a-41fe-8edf-e3fc4bb95842 req-4fa0ab36-cdb2-41a5-93d0-b31fcc4e2f7a tempest-ServerGroupTestJSON-202615986 tempest-ServerGroupTestJSON-202615986-project-member] Enqueued Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_members [ 828.081595] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_members [ 828.081921] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.085729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.085848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.086125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.086311] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.086426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.086520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.086689] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.086760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.086807] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.137803] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.138228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.138228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.138485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.138723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.138914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.138953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.139209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.139307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.139451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.139690] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.139748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.139792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.139942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.140124] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.140232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.140326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.140485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.140581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.140747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.140747] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.193560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.193722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.193990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.194101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.194189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.194420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.194540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.194619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.194819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.194930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.195063] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be updated. [ 828.236204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.236204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.236204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.236204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.236204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.245925] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: IN_PROGRESS for 2s [ 828.568829] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 828.568829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.568829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.568829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.568829] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.590081] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.590081] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.590081] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 already deleted. [ 828.590081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.648540] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c: rpc.has_security_group_logging(os_id): False [ 828.665983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.665983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.665983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.665983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.669632] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.669881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.674088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.674088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.674088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.674088] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c is going to be created. [ 828.679546] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.679735] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-245" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.679859] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-245" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.680296] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-245" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.680990] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.683506] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.683665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.684038] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.684148] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.684502] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.684629] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.684950] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.686260] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.686497] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.686628] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.687412] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.708074] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.708290] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.708431] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.708641] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-245" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.708990] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-262fed9b-0e79-4131-a6de-c53ddf302b5a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.709185] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.709409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.709982] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.709982] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('262fed9b-0e79-4131-a6de-c53ddf302b5a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.735265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.735370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.735434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.735653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.735841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.748075] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c in Status: IN_PROGRESS for 2s [ 829.004949] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 829.004949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.005134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.005438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.005534] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.005641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.005702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.005854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.005939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.006042] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.008206] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 829.008672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.008840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.009020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.009222] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.009315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.009404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.009501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.009583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.009675] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.072691] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.072691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.213038] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.213413] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.213536] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.213890] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.214184] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.214401] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 262fed9b-0e79-4131-a6de-c53ddf302b5a not found, creating... [ 829.214739] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.214943] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.215114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.215413] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.215586] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.215942] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.216136] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.216257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.216470] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.216607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.216748] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 262fed9b-0e79-4131-a6de-c53ddf302b5a is going to be created. [ 829.218616] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: SUCCESS [ 829.218806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.242845] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.243113] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.243309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.243617] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.243942] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.244229] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.516163] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.517544] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.611482] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 829.611482] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 deletion is rescheduled due to dependency. [ 829.611482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.676093] env[69847]: INFO networking_nsxv3.common.synchronization [req-974582a4-9d5b-49f4-b7d6-06463b8d5cdb req-18072f25-24e6-42c7-8cb1-ed1ad366b7a5 tempest-ServersTestFqdnHostnames-1597567196 tempest-ServersTestFqdnHostnames-1597567196-project-member] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_members [ 829.676675] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGHEST for action security_group_members [ 829.677040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.677153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.677219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.677424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.679351] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.679351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.679351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.679351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.679351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.679351] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.020401] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.021471] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.180450] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.180901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.181245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.182011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.182065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.182348] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.182534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.182590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.182819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.182856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.182936] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 is going to be updated. [ 830.214720] env[69847]: INFO networking_nsxv3.common.synchronization [req-f55c18d3-fa1a-41fe-8edf-e3fc4bb95842 req-5941bed5-3beb-485b-8b6e-abc1ef300b3a service nova] Enqueued Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_rules [ 830.214720] env[69847]: INFO networking_nsxv3.common.synchronization [req-f55c18d3-fa1a-41fe-8edf-e3fc4bb95842 req-5941bed5-3beb-485b-8b6e-abc1ef300b3a service nova] Enqueued Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_members [ 830.214720] env[69847]: INFO networking_nsxv3.common.synchronization [req-f55c18d3-fa1a-41fe-8edf-e3fc4bb95842 req-5941bed5-3beb-485b-8b6e-abc1ef300b3a service nova] Enqueued Resource ID: 262fed9b-0e79-4131-a6de-c53ddf302b5a with Priority: HIGHEST for action port [ 830.214720] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_rules [ 830.214720] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_members [ 830.214720] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 262fed9b-0e79-4131-a6de-c53ddf302b5a with Priority: HIGHEST for action port [ 830.215185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.215253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.215461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.215682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.215833] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.217899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.218042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.218042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.220282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.220282] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.220282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.220282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.220282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.220282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.220282] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.220282] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-262fed9b-0e79-4131-a6de-c53ddf302b5a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.220792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.220792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.220792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.220792] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('262fed9b-0e79-4131-a6de-c53ddf302b5a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.222629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.222629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.222629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.222833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.223180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.233667] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 in Status: IN_PROGRESS for 2s [ 830.255324] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 830.257065] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c deletion is rescheduled due to dependency. [ 830.257065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.524743] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.524969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.525115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.525416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.525526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.525633] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be updated. [ 830.528060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.528228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.528276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.528484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.529257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.529257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 830.554601] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.554601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.554796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.554953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.555068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.557559] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.557739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.557835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.558163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.558378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.567681] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 830.568738] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 830.722977] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.722977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.728594] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.728594] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 262fed9b-0e79-4131-a6de-c53ddf302b5a with status ACTIVE [ 830.728594] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.728594] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.728594] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.728594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.729595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.729595] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 262fed9b-0e79-4131-a6de-c53ddf302b5a is going to be updated. [ 830.750282] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.750282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.750282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.750282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.750282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.750282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-262fed9b-0e79-4131-a6de-c53ddf302b5a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.761376] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c in Status: SUCCESS [ 830.761791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.221130] env[69847]: INFO networking_nsxv3.common.synchronization [req-7d90f2a9-527e-4634-a447-7db9334257a8 req-73e7a8b4-81ea-4cda-9811-a6d0be756b42 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_members [ 831.221130] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGHEST for action security_group_members [ 831.221130] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.221908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.222120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.222433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.222745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.222988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.223169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.223447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.223671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.223870] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.231059] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.327325] env[69847]: INFO networking_nsxv3.common.synchronization [req-f08f39c9-235c-41a6-93c4-0eb7ba2571f7 req-46c4a072-b521-4f7d-b13c-6023b14d8589 tempest-ListServerFiltersTestJSON-552165178 tempest-ListServerFiltersTestJSON-552165178-project-member] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 831.327325] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGHEST for action security_group_members [ 831.327325] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.327724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.327948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.328327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.328682] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.329942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.330194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.330547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.330816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.331068] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.727505] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.727666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.727807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.727994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.728192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.728745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.728745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.728745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.728745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.728745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.728968] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 is going to be updated. [ 831.738049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.738303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.738347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.738576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.738665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.738755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 is going to be created. [ 831.754195] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.754468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.754468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.754643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.755101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.757482] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.757707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.757791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.757972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.758140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.766639] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea12339-45c6-49af-909a-f5d031f10029 in Status: IN_PROGRESS for 2s [ 831.767663] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 in Status: UNINITIALIZED for 2s [ 831.835389] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.835697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.835697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.836259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.836373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.836606] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.836723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.836790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.836966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.837063] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.837271] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be updated. [ 831.861843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.862044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.862090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.866026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.866026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.869789] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: IN_PROGRESS for 2s [ 831.985448] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7e96d3fe-dda7-44fc-8357-cb27758aa7e0 None None] Enqueued Resource ID: 82615ef7-1574-44e2-afcc-6ee9fe2ce455 with Priority: HIGHEST for action port [ 831.985777] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82615ef7-1574-44e2-afcc-6ee9fe2ce455 with Priority: HIGHEST for action port [ 831.986265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-82615ef7-1574-44e2-afcc-6ee9fe2ce455 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.986396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82615ef7-1574-44e2-afcc-6ee9fe2ce455" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.986462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82615ef7-1574-44e2-afcc-6ee9fe2ce455" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.986735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82615ef7-1574-44e2-afcc-6ee9fe2ce455" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.987012] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82615ef7-1574-44e2-afcc-6ee9fe2ce455',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.247359] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 in Status: SUCCESS [ 832.247785] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 deletion is rescheduled due to dependency. [ 832.247785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.488961] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82615ef7-1574-44e2-afcc-6ee9fe2ce455 [ 832.489282] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.489421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.489480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.490071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.490071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.490071] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82615ef7-1574-44e2-afcc-6ee9fe2ce455 already deleted. [ 832.490071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82615ef7-1574-44e2-afcc-6ee9fe2ce455" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.579321] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 832.579615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.580116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.580116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.580269] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.580269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.580431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.580481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.580535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.580620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.580835] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.580939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.580995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.581142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.581278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.581359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.581436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.581618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.581722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.581796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.581882] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.583351] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 832.583531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.583811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.583936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.584149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.584303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.584303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.584468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.584533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.584657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.584711] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.086083] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88aae7-5837-4451-89b6-8972ab00f699: rpc.has_security_group_logging(os_id): False [ 833.087287] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.105415] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.105503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.105556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.105858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.106061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.106259] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.106418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.106486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.106688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.106824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.106983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.107093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.107156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.107319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.107396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.107614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.107739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.107835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.107926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.108010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.108120] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 833.203744] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.203872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.203951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.204200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.204350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.219548] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 833.590274] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 804e0265-2d3b-49e8-899e-80d4d047aae0: rpc.has_security_group_logging(os_id): False [ 833.609729] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.609944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.610052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.610350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.610494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.611019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.611019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.611180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.611266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.611391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.611522] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be updated. [ 833.663649] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.663842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.663842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.664108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.664257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.674820] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 833.777432] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ea12339-45c6-49af-909a-f5d031f10029 in Status: SUCCESS [ 833.777614] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 deletion is rescheduled due to dependency. [ 833.777659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.778353] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 in Status: SUCCESS [ 833.778528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.778674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.778884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.779075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.779190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.779255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.779409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.779493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.779666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.779867] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.878655] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 in Status: SUCCESS [ 833.878850] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 deletion is rescheduled due to dependency. [ 833.878949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.123596] env[69847]: INFO networking_nsxv3.common.synchronization [None req-f9f82781-0b48-4234-949b-1112eb304c88 None None] Enqueued Resource ID: 4c157483-e4cf-4194-b192-a186c14e1ab0 with Priority: HIGHEST for action port [ 834.125614] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c157483-e4cf-4194-b192-a186c14e1ab0 with Priority: HIGHEST for action port [ 834.126622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c157483-e4cf-4194-b192-a186c14e1ab0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.126622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c157483-e4cf-4194-b192-a186c14e1ab0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.126622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c157483-e4cf-4194-b192-a186c14e1ab0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.126622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c157483-e4cf-4194-b192-a186c14e1ab0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.126622] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c157483-e4cf-4194-b192-a186c14e1ab0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.282154] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.282407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.282407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.282661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.282852] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.282980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.283126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.283249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.283382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.283467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.283652] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.283745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.283824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.283974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.284162] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.284272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.284367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.284506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.284579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.284679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.284773] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.628870] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c157483-e4cf-4194-b192-a186c14e1ab0 [ 834.629328] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.629580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.629735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.630122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.630351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.630573] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c157483-e4cf-4194-b192-a186c14e1ab0 already deleted. [ 834.630755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c157483-e4cf-4194-b192-a186c14e1ab0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.787402] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e7f5569-d370-40fa-81c6-135bdeca6427: rpc.has_security_group_logging(os_id): False [ 834.804694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.804933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.805046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.805325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.805474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.805735] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.805912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.806038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.806271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.806413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.806685] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.806840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.806949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.807173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.807302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.807582] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.807734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.807835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.808060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.808212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.808351] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 is going to be created. [ 834.859837] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.859837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.859837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.860128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.860164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.870258] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 in Status: IN_PROGRESS for 2s [ 835.233636] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 835.233917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.234208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.234384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.234473] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.687446] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 835.687747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.736542] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.736692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.736692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.736945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.737201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.737314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.737382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.737590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.737634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.737705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.737800] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.242742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.242742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.242742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.242742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.242742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.243629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.243629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.243629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.243629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.243629] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.747343] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88aae7-5837-4451-89b6-8972ab00f699: rpc.has_security_group_logging(os_id): False [ 836.765242] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.765321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.766142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.766142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.766142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.766142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.766142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.766142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.766405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.766405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.766503] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.766984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.767132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.767312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.767396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.767606] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.767706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.767770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.767915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.767996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.768098] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 836.826469] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.826612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.826683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.827444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.827444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.843400] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 836.887338] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 in Status: SUCCESS [ 836.887338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.858857] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 838.859113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.126680] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 839.126838] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 840.154632] env[69847]: INFO networking_nsxv3.common.synchronization [req-87bdc1cc-0eb5-4fb1-9704-1948e9368381 req-632ba415-37e9-4e88-8beb-5b613b1350c3 tempest-ServerDiagnosticsTest-1332920507 tempest-ServerDiagnosticsTest-1332920507-project-member] Enqueued Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_members [ 840.154990] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGHEST for action security_group_members [ 840.155321] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.155438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.155500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.155704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.156267] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.156267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.156267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.156267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.156267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.156543] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.236546] env[69847]: INFO networking_nsxv3.common.synchronization [req-cedc1bfc-8f62-4fd9-a10e-8aee66596096 req-79f21674-2504-4854-a948-0250f586d3e6 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 840.237148] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 840.237384] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.237504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.237567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.237759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.237936] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.239175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.239662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.239662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.239662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.239662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.658603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.658790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.658857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.659053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.659946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.659946] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.659946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.659946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.659946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.659946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.659946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c is going to be updated. [ 840.688659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.688865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.688955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.689212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.689360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.698020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c in Status: IN_PROGRESS for 2s [ 840.741555] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.741771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.741840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.742116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.742217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.742419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.742536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.742687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.742932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.743098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.743199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 840.778024] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.778024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.778024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.778024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.778024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.787672] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 842.177282] env[69847]: INFO networking_nsxv3.common.synchronization [req-cae036f3-a746-4866-9050-704fd765d57b req-7d372337-9874-4f5f-83f3-4712f103acc1 tempest-ServerGroupTestJSON-202615986 tempest-ServerGroupTestJSON-202615986-project-member] Enqueued Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_members [ 842.182037] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGHEST for action security_group_members [ 842.187012] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.187012] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.187012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.187012] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.335625] env[69847]: INFO networking_nsxv3.common.synchronization [None req-f3bed74f-665f-4bce-95b7-25919a4fa0cc None None] Enqueued Resource ID: 922fac5f-5a57-447f-97eb-b1646106c204 with Priority: HIGHEST for action port [ 842.337529] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 922fac5f-5a57-447f-97eb-b1646106c204 with Priority: HIGHEST for action port [ 842.337529] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-922fac5f-5a57-447f-97eb-b1646106c204 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.337529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-922fac5f-5a57-447f-97eb-b1646106c204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.337529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-922fac5f-5a57-447f-97eb-b1646106c204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.337529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-922fac5f-5a57-447f-97eb-b1646106c204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.337529] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('922fac5f-5a57-447f-97eb-b1646106c204',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.688643] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.688838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.688922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.689183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.689281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.689476] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.689598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.689655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.690376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.690376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.690376] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 is going to be updated. [ 842.695835] env[69847]: INFO networking_nsxv3.common.synchronization [req-00fe0c1e-2911-432d-8fce-5f4f04318c14 req-e73ee2f3-8010-4f66-9576-106877817ee0 tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 842.696300] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 842.696620] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.696758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.696821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.697082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.697278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.697381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.700583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.700583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.700583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.700583] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.706567] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c in Status: SUCCESS [ 842.706738] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c deletion is rescheduled due to dependency. [ 842.706839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.717829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.717829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.717990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.718464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.718464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.726320] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 in Status: IN_PROGRESS for 2s [ 842.797454] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 842.797647] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe deletion is rescheduled due to dependency. [ 842.797739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.840329] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 922fac5f-5a57-447f-97eb-b1646106c204 [ 842.840565] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.840712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.840843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.841102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.841227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.841331] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:922fac5f-5a57-447f-97eb-b1646106c204 already deleted. [ 842.841418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-922fac5f-5a57-447f-97eb-b1646106c204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.113423] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.113659] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.113732] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.114083] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.114342] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.114499] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.114616] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.114838] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.115078] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.115842] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.115989] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.116120] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.116230] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.116342] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.116449] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.116586] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.136357] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.136525] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.136705] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.136841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.137612] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3e6619ef-879a-4e62-a8d2-deff62d17168 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.137612] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.137612] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.137776] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.137907] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6619ef-879a-4e62-a8d2-deff62d17168',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.201506] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.201860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.201860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.202172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.202172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.202309] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.202409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.202470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.202625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.202717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.202823] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f already deleted. [ 843.203882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.640430] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.640638] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.640766] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.641078] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.641205] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.641356] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3e6619ef-879a-4e62-a8d2-deff62d17168 not found, creating... [ 843.641932] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.642138] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.643103] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.643103] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.643103] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.643103] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.643103] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.643351] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.643386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.643683] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.643683] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3e6619ef-879a-4e62-a8d2-deff62d17168 is going to be created. [ 843.666021] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.666021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.666021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.666021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.666021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.666327] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.401725] env[69847]: INFO networking_nsxv3.common.synchronization [req-00fe0c1e-2911-432d-8fce-5f4f04318c14 req-5a42ca2d-0f4e-4637-b250-62939704e255 service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 844.402025] env[69847]: INFO networking_nsxv3.common.synchronization [req-00fe0c1e-2911-432d-8fce-5f4f04318c14 req-5a42ca2d-0f4e-4637-b250-62939704e255 service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 844.402025] env[69847]: INFO networking_nsxv3.common.synchronization [req-00fe0c1e-2911-432d-8fce-5f4f04318c14 req-5a42ca2d-0f4e-4637-b250-62939704e255 service nova] Enqueued Resource ID: 3e6619ef-879a-4e62-a8d2-deff62d17168 with Priority: HIGHEST for action port [ 844.402542] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 844.402700] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 844.402758] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6619ef-879a-4e62-a8d2-deff62d17168 with Priority: HIGHEST for action port [ 844.404480] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.404663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.404709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.404915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.404993] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.406681] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.406773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.406918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.409018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.409018] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.409018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6619ef-879a-4e62-a8d2-deff62d17168 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.409018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.409018] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6619ef-879a-4e62-a8d2-deff62d17168',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.741798] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 in Status: SUCCESS [ 844.741798] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 deletion is rescheduled due to dependency. [ 844.741798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.849504] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8eb5c64a-aafb-426b-8054-3ed499748ede None None] Enqueued Resource ID: cbec0af3-954d-4fde-9c14-b23303e79c3f with Priority: HIGHEST for action port [ 844.849504] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbec0af3-954d-4fde-9c14-b23303e79c3f with Priority: HIGHEST for action port [ 844.850142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbec0af3-954d-4fde-9c14-b23303e79c3f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.850262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbec0af3-954d-4fde-9c14-b23303e79c3f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.850326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbec0af3-954d-4fde-9c14-b23303e79c3f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.850568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbec0af3-954d-4fde-9c14-b23303e79c3f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.850646] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbec0af3-954d-4fde-9c14-b23303e79c3f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.910574] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.910574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.914368] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.914368] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e6619ef-879a-4e62-a8d2-deff62d17168 with status ACTIVE [ 844.914368] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.914368] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.914368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.917328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.917659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.917890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.918411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.918748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.920832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.920832] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e6619ef-879a-4e62-a8d2-deff62d17168 is going to be updated. [ 844.940666] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.940666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.940666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.940666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.940666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.940666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6619ef-879a-4e62-a8d2-deff62d17168" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.356434] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbec0af3-954d-4fde-9c14-b23303e79c3f [ 845.356766] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.356850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.356955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.357160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.357255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.357348] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbec0af3-954d-4fde-9c14-b23303e79c3f already deleted. [ 845.357430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbec0af3-954d-4fde-9c14-b23303e79c3f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.421503] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.923785] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.924811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.925038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.925342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.925550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.925737] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be created. [ 845.948614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.949733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.949822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.950070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.950250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.958867] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: UNINITIALIZED for 2s [ 846.307304] env[69847]: INFO networking_nsxv3.common.synchronization [req-152876bd-397c-4304-9e46-ccbfdab10193 req-a2ec1178-8e4e-497b-8243-cd0201a4560b tempest-TenantUsagesTestJSON-1739488608 tempest-TenantUsagesTestJSON-1739488608-project-member] Enqueued Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_members [ 846.308050] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_members [ 846.308050] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.308660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.308802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.309099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.309269] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.309374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.309436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.309620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.309705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.309798] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.812040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.812377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.812377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.812577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.812919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.812919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.813039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.813113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.813540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.813540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.813540] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 already deleted. [ 846.813540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.013844] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.014078] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.014239] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.014541] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.014796] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.014978] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.015091] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.015355] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.015507] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.015771] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.015898] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.016024] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.016144] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.016267] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.016378] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.016505] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.034363] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.034564] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.034676] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.035061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.035191] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-cf64f0ca-e417-4033-af68-436843959908 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.035368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.035535] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.035808] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.035950] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf64f0ca-e417-4033-af68-436843959908',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.541266] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.541467] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.541595] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.541917] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.542081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.542241] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port cf64f0ca-e417-4033-af68-436843959908 not found, creating... [ 847.542493] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.542649] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.542777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.543020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.543162] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.543465] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.543630] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.543779] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.543996] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.544154] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.544302] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: cf64f0ca-e417-4033-af68-436843959908 is going to be created. [ 847.562925] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.563166] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.563700] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.563700] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.563809] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.563977] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.970066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 847.970360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.970500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.970671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.970862] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.970979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.971059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.971213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.971297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.971379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.971468] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.474969] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.562731] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4163004e-e4e3-4454-8906-5a64ba35093a None None] Enqueued Resource ID: 5f6e1cb0-6ae8-4261-ae18-a5801fd85234 with Priority: HIGHEST for action port [ 848.563616] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6e1cb0-6ae8-4261-ae18-a5801fd85234 with Priority: HIGHEST for action port [ 848.565933] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f6e1cb0-6ae8-4261-ae18-a5801fd85234 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.565933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f6e1cb0-6ae8-4261-ae18-a5801fd85234" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.565933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f6e1cb0-6ae8-4261-ae18-a5801fd85234" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.565933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f6e1cb0-6ae8-4261-ae18-a5801fd85234" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.565933] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f6e1cb0-6ae8-4261-ae18-a5801fd85234',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.763424] env[69847]: INFO networking_nsxv3.common.synchronization [req-1aa67301-dae1-4672-b6be-03468358d505 req-af8e3d76-ffc7-4e9c-85d2-a6e2ba6bef7e tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 848.764085] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 848.765084] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.765084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.765084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.765084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.765367] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.765900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.766489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.770231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.770385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.770525] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.872145] env[69847]: INFO networking_nsxv3.common.synchronization [req-152876bd-397c-4304-9e46-ccbfdab10193 req-5249974a-7194-4736-9020-5f6b8259c0be service nova] Enqueued Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_rules [ 848.872550] env[69847]: INFO networking_nsxv3.common.synchronization [req-152876bd-397c-4304-9e46-ccbfdab10193 req-5249974a-7194-4736-9020-5f6b8259c0be service nova] Enqueued Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_members [ 848.872733] env[69847]: INFO networking_nsxv3.common.synchronization [req-152876bd-397c-4304-9e46-ccbfdab10193 req-5249974a-7194-4736-9020-5f6b8259c0be service nova] Enqueued Resource ID: cf64f0ca-e417-4033-af68-436843959908 with Priority: HIGHEST for action port [ 848.873550] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_rules [ 848.873550] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_members [ 848.874776] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf64f0ca-e417-4033-af68-436843959908 with Priority: HIGHEST for action port [ 848.874776] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.874776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.874776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.874776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.874776] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.878169] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.878169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.878169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.878385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.879040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.879040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.879040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.879040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.879040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.879040] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.879862] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf64f0ca-e417-4033-af68-436843959908 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.879976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.880055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.880219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.880297] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf64f0ca-e417-4033-af68-436843959908',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.979424] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7c8712-c7ea-4340-b068-333e83abf23f: rpc.has_security_group_logging(os_id): False [ 849.000131] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.000131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.000131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.000131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.000131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.000383] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.000434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.000477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.000660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.000758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.000866] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be created. [ 849.062554] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.062703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.062772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.062967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.063162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.068668] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f6e1cb0-6ae8-4261-ae18-a5801fd85234 [ 849.068849] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.069048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.069048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.069284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.069355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.069439] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f6e1cb0-6ae8-4261-ae18-a5801fd85234 already deleted. [ 849.069580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f6e1cb0-6ae8-4261-ae18-a5801fd85234" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.073830] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 849.275144] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.275144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.275144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.275144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.275144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.275144] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.275144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.275496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.275496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.275496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.275496] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad already deleted. [ 849.275662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.365792] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.365990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.366131] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.366477] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.366742] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.366908] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.367457] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.368121] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.368229] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.368460] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.368541] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.368724] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.368794] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.368865] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.369116] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.369116] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.378680] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.378839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.382175] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.386770] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf64f0ca-e417-4033-af68-436843959908 with status ACTIVE [ 849.386770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.386770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386770] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf64f0ca-e417-4033-af68-436843959908 is going to be updated. [ 849.387548] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.387618] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.387843] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.388115] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.388417] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.388586] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.388739] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.389012] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.389186] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b31db8-a2f4-4ec2-bcbb-e302478b48ac',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.411136] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.411282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.412026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.412026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.412026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.412026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf64f0ca-e417-4033-af68-436843959908" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.893022] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.893022] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.893022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.893022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.893022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.893022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.893022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port b2b31db8-a2f4-4ec2-bcbb-e302478b48ac not found, creating... [ 849.893366] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.893366] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.893366] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.893545] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.893660] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.894152] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.894312] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.894555] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.895793] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.895793] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.895793] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: b2b31db8-a2f4-4ec2-bcbb-e302478b48ac is going to be created. [ 849.915233] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.915582] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.915582] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.915890] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.916072] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.916289] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.398389] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.398389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.398389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.398389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.398389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.398389] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 is going to be created. [ 850.419963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.420124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.420180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.420385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.420534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.431418] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: UNINITIALIZED for 2s [ 850.773351] env[69847]: INFO networking_nsxv3.common.synchronization [req-1aa67301-dae1-4672-b6be-03468358d505 req-e36f528d-9711-447f-adc3-d422f2c66726 service nova] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 850.773505] env[69847]: INFO networking_nsxv3.common.synchronization [req-1aa67301-dae1-4672-b6be-03468358d505 req-e36f528d-9711-447f-adc3-d422f2c66726 service nova] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 850.773635] env[69847]: INFO networking_nsxv3.common.synchronization [req-1aa67301-dae1-4672-b6be-03468358d505 req-e36f528d-9711-447f-adc3-d422f2c66726 service nova] Enqueued Resource ID: b2b31db8-a2f4-4ec2-bcbb-e302478b48ac with Priority: HIGHEST for action port [ 850.774147] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 850.774214] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 850.774382] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2b31db8-a2f4-4ec2-bcbb-e302478b48ac with Priority: HIGHEST for action port [ 850.774833] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.775086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.775276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.775580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.775686] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.776968] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.776968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.776968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.777134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.777307] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.777432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.777513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.777718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.777829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.778031] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.778854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.778982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.779081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.779290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.779406] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2b31db8-a2f4-4ec2-bcbb-e302478b48ac',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.081384] env[69847]: INFO networking_nsxv3.common.synchronization [None req-cde45955-c53d-4702-8bb5-1b93b05a5bbf None None] Enqueued Resource ID: 75f0fd20-6cc6-407d-a717-c27c2d52d96a with Priority: HIGHEST for action port [ 851.082554] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75f0fd20-6cc6-407d-a717-c27c2d52d96a with Priority: HIGHEST for action port [ 851.083332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-75f0fd20-6cc6-407d-a717-c27c2d52d96a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.083454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75f0fd20-6cc6-407d-a717-c27c2d52d96a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.083578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75f0fd20-6cc6-407d-a717-c27c2d52d96a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.083936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75f0fd20-6cc6-407d-a717-c27c2d52d96a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.084065] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75f0fd20-6cc6-407d-a717-c27c2d52d96a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.090994] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 851.095219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.282436] env[69847]: INFO networking_nsxv3.common.synchronization [req-328ef5e8-2b4d-46f7-b60a-16f452b6bc66 req-b3a4dde6-7dff-4e97-8ff9-869ec6390430 tempest-ServerPasswordTestJSON-568929046 tempest-ServerPasswordTestJSON-568929046-project-member] Enqueued Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_members [ 851.282840] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.282950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.283128] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.288693] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2b31db8-a2f4-4ec2-bcbb-e302478b48ac with status ACTIVE [ 851.288693] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.288693] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.288693] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.288693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.288693] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2b31db8-a2f4-4ec2-bcbb-e302478b48ac is going to be updated. [ 851.290325] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_members [ 851.290727] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.290803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.290871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.291351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.291351] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.291847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.291847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.291847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.291847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.292205] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.310635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.310948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.311120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.311439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.311669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.311971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2b31db8-a2f4-4ec2-bcbb-e302478b48ac" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.536621] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d95fd7c4-c0ec-4fbf-9987-8376f30050c2 None None] Enqueued Resource ID: c2de4e7c-26a0-4757-95ae-053ad3251dad with Priority: HIGHEST for action port [ 851.536978] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2de4e7c-26a0-4757-95ae-053ad3251dad with Priority: HIGHEST for action port [ 851.537805] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2de4e7c-26a0-4757-95ae-053ad3251dad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.537805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2de4e7c-26a0-4757-95ae-053ad3251dad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.537805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2de4e7c-26a0-4757-95ae-053ad3251dad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.538110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2de4e7c-26a0-4757-95ae-053ad3251dad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.538204] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2de4e7c-26a0-4757-95ae-053ad3251dad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.587317] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75f0fd20-6cc6-407d-a717-c27c2d52d96a [ 851.587317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.587317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.587317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.587317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.587317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.587737] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75f0fd20-6cc6-407d-a717-c27c2d52d96a already deleted. [ 851.587737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75f0fd20-6cc6-407d-a717-c27c2d52d96a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.790269] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.794164] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.794325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.794375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.794578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.794670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.794851] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.794951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.795164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.795352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.795432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.795519] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d08516-0c16-4674-ac9d-29023bc28795 already deleted. [ 851.795601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.041393] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2de4e7c-26a0-4757-95ae-053ad3251dad [ 852.041393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.041393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.041393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.041393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.041393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.041393] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2de4e7c-26a0-4757-95ae-053ad3251dad already deleted. [ 852.041393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2de4e7c-26a0-4757-95ae-053ad3251dad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.077061] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.077061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-477" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.077061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-477" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.077061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-477" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.077061] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.077061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.077061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.079096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.079096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.079096] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.079096] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.079096] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.079096] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.079096] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.079096] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.079096] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.097930] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.098302] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.098520] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.098989] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-477" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.099390] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ccb0d4e0-89c8-4a99-9adf-c1941254f284 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.099667] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.100271] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.100676] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.100888] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb0d4e0-89c8-4a99-9adf-c1941254f284',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.294597] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.294761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.294817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.295048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.295145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.295242] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be created. [ 852.317851] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.318062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.318120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.318300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.318467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.328283] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: UNINITIALIZED for 2s [ 852.439690] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: SUCCESS [ 852.440779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.440989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.441255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.441456] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.441574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.441641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.441903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.441903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.441993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.442165] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.605973] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.605973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.605973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.605973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.605973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.606454] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ccb0d4e0-89c8-4a99-9adf-c1941254f284 not found, creating... [ 852.606454] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.606454] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.606623] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.606862] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.606911] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.607234] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.607396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.607928] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.608219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.608362] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.608498] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ccb0d4e0-89c8-4a99-9adf-c1941254f284 is going to be created. [ 852.632011] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.632233] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.632357] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.632620] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.632860] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.633101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.944699] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.944884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.944955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.945215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.945417] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.945525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.945591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.945771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.945859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.945962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.946138] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.946237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.946287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.946483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.946636] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.946732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.946794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.946935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.947021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.947104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.947258] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.030359] env[69847]: INFO networking_nsxv3.common.synchronization [None req-66a37c22-55e8-45f6-b047-9f2d9079985b tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 853.030840] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 853.032315] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.032315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.032315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.032315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.032492] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.288228] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c3e58b39-31b4-4b3d-97d1-13d7be38d320 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 853.288791] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 853.289171] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.289260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.412460] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c0c849af-b346-4d9a-9a44-239a8beb4b26 None None] Enqueued Resource ID: 4b3ebf57-f479-4ca8-8b84-5b50cc537174 with Priority: HIGHEST for action port [ 853.412460] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b3ebf57-f479-4ca8-8b84-5b50cc537174 with Priority: HIGHEST for action port [ 853.413019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b3ebf57-f479-4ca8-8b84-5b50cc537174 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.413019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b3ebf57-f479-4ca8-8b84-5b50cc537174" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.413019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b3ebf57-f479-4ca8-8b84-5b50cc537174" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.413530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b3ebf57-f479-4ca8-8b84-5b50cc537174" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.413621] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b3ebf57-f479-4ca8-8b84-5b50cc537174',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.451297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0084e13-9513-4d73-a5ee-3f7440f23dd3: rpc.has_security_group_logging(os_id): False [ 853.471698] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.471857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.471927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.472315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.472315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.472461] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.472553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.472606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.473409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.473409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.473409] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.473409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.473409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.473409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.473409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.473751] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.473751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.473751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.474023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.474023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.474023] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 is going to be created. [ 853.538188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.538316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.538418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.538585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.538758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.548594] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: IN_PROGRESS for 2s [ 853.550794] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.550959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.551034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.551396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.551396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.551396] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e already deleted. [ 853.551739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.551739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.552160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.552160] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.915888] env[69847]: INFO networking_nsxv3.common.synchronization [req-328ef5e8-2b4d-46f7-b60a-16f452b6bc66 req-efb1cca7-a0ce-4cc1-ac5f-5d2ca15e3521 service nova] Enqueued Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_rules [ 853.915888] env[69847]: INFO networking_nsxv3.common.synchronization [req-328ef5e8-2b4d-46f7-b60a-16f452b6bc66 req-efb1cca7-a0ce-4cc1-ac5f-5d2ca15e3521 service nova] Enqueued Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_members [ 853.915888] env[69847]: INFO networking_nsxv3.common.synchronization [req-328ef5e8-2b4d-46f7-b60a-16f452b6bc66 req-efb1cca7-a0ce-4cc1-ac5f-5d2ca15e3521 service nova] Enqueued Resource ID: ccb0d4e0-89c8-4a99-9adf-c1941254f284 with Priority: HIGHEST for action port [ 853.915888] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_rules [ 853.915888] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_members [ 853.915888] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb0d4e0-89c8-4a99-9adf-c1941254f284 with Priority: HIGHEST for action port [ 853.916434] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.916434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.916434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.916549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.916712] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.922195] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.922195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.922195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.923149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.927028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.927028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.927028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.927028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.927028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.927028] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.927028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccb0d4e0-89c8-4a99-9adf-c1941254f284 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.927028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.927028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.927508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.927508] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccb0d4e0-89c8-4a99-9adf-c1941254f284',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.928643] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b3ebf57-f479-4ca8-8b84-5b50cc537174 [ 853.930228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.930409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.930462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.930659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.930772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.930883] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b3ebf57-f479-4ca8-8b84-5b50cc537174 already deleted. [ 853.931097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b3ebf57-f479-4ca8-8b84-5b50cc537174" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.072211] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.072422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.072422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.072638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.072721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.072758] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e already deleted. [ 854.072848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.337792] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 854.338093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.338168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.338392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.338573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.338739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.338739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.338931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.338986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.339070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.339128] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.430445] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.430577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.432026] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.433463] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccb0d4e0-89c8-4a99-9adf-c1941254f284 with status ACTIVE [ 854.433463] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.433463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.433463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.433610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.433610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.433758] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.433858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.433915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.434092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.434167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.434343] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.437019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.437019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.437019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.437019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.437019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccb0d4e0-89c8-4a99-9adf-c1941254f284 is going to be updated. [ 854.458733] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.458907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.458986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.459250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.459403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.459666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccb0d4e0-89c8-4a99-9adf-c1941254f284" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.841416] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.940736] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.099605] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8a0027fd-bd63-4046-aa7c-bb579247f40c tempest-MigrationsAdminTest-1749055771 tempest-MigrationsAdminTest-1749055771-project-member] Enqueued Resource ID: 53935658-9f75-41b7-b79a-7e4887a20c29 with Priority: HIGHEST for action security_group_rules [ 855.100466] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53935658-9f75-41b7-b79a-7e4887a20c29 with Priority: HIGHEST for action security_group_rules [ 855.100795] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53935658-9f75-41b7-b79a-7e4887a20c29 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.100922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.100984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.101279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.101364] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53935658-9f75-41b7-b79a-7e4887a20c29',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.345651] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8982c0b6-8a83-4e29-82e9-02c4a6ebebad: rpc.has_security_group_logging(os_id): False [ 855.362191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.362334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.362408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.366020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.366020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.366020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.366020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.366020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.366020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.366020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.366020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be created. [ 855.418684] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.419021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.419181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.419472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.420340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.425431] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ce223d79-f804-4493-9472-98634a857744 tempest-MigrationsAdminTest-1749055771 tempest-MigrationsAdminTest-1749055771-project-member] Enqueued Resource ID: 53935658-9f75-41b7-b79a-7e4887a20c29 with Priority: HIGHEST for action security_group_rules [ 855.426110] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53935658-9f75-41b7-b79a-7e4887a20c29 with Priority: HIGHEST for action security_group_rules [ 855.426492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53935658-9f75-41b7-b79a-7e4887a20c29 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.426718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.434483] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 855.443514] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.443887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.445964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.445964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.445964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.445964] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d08516-0c16-4674-ac9d-29023bc28795 is going to be created. [ 855.476256] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.477282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.477677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.478410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.478716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.487175] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d08516-0c16-4674-ac9d-29023bc28795 in Status: UNINITIALIZED for 2s [ 855.560297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: SUCCESS [ 855.560542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.623816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.623890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.623996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.624270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.624372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.624469] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53935658-9f75-41b7-b79a-7e4887a20c29 already deleted. [ 855.624551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.624699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.624862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.624946] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53935658-9f75-41b7-b79a-7e4887a20c29',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.147797] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.148255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.148255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.148255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.148397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.148444] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53935658-9f75-41b7-b79a-7e4887a20c29 already deleted. [ 856.148489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53935658-9f75-41b7-b79a-7e4887a20c29" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.659306] env[69847]: INFO networking_nsxv3.common.synchronization [req-dd67fd3c-895d-4379-97d8-08d447fa2c39 req-9f76c187-3959-4fb8-a3a1-3baba2d8153b tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_members [ 856.659306] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_members [ 856.659306] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.659306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.659306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.659306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.659306] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.660989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.661104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.661325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.661428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.661533] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.165189] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.165486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.165486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.165663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.165767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.165991] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.166111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.166185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.166347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.166425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.166511] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 already deleted. [ 857.166589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.253161] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.253321] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.253398] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.253666] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.253925] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.254095] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.254213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.254438] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.254791] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.254791] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.254898] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.254989] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.255106] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.255209] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.255308] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.255433] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.277972] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.278435] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.278435] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.278575] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.278764] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.278930] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.279057] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.280382] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.280511] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e4ab4f1-01ef-431e-a334-8b7e243f15bb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.444990] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 857.445266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.495921] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d08516-0c16-4674-ac9d-29023bc28795 in Status: SUCCESS [ 857.496149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.496309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.496522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.496703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.496843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.496878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.497039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.497121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.497224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.497289] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.784596] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.784710] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.784927] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.785120] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.785853] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.785853] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 1e4ab4f1-01ef-431e-a334-8b7e243f15bb not found, creating... [ 857.785853] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.785853] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786131] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.786301] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.786440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.786728] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.787139] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.787139] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.787239] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.787471] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.787524] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 1e4ab4f1-01ef-431e-a334-8b7e243f15bb is going to be created. [ 857.805729] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.805951] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.806114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.806605] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.806605] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.806820] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.000199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.000695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.000695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.000695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.000857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.000922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.000998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.001173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.001259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.001344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.001483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.002181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.002181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.002181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.002181] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.002181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.002181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.002404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.002404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.002404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.002502] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.506137] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39d08516-0c16-4674-ac9d-29023bc28795: rpc.has_security_group_logging(os_id): False [ 858.525735] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.526184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.526184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.528029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.528029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.528623] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.528623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.528623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.528623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.528810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.528874] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.531647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.531647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.531647] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d08516-0c16-4674-ac9d-29023bc28795 is going to be created. [ 858.574257] env[69847]: INFO networking_nsxv3.common.synchronization [req-dd67fd3c-895d-4379-97d8-08d447fa2c39 req-f833e01f-3873-469c-be88-2383e0e3d043 service nova] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_rules [ 858.574257] env[69847]: INFO networking_nsxv3.common.synchronization [req-dd67fd3c-895d-4379-97d8-08d447fa2c39 req-f833e01f-3873-469c-be88-2383e0e3d043 service nova] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_members [ 858.574401] env[69847]: INFO networking_nsxv3.common.synchronization [req-dd67fd3c-895d-4379-97d8-08d447fa2c39 req-f833e01f-3873-469c-be88-2383e0e3d043 service nova] Enqueued Resource ID: 1e4ab4f1-01ef-431e-a334-8b7e243f15bb with Priority: HIGHEST for action port [ 858.574652] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_rules [ 858.574788] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_members [ 858.574894] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4ab4f1-01ef-431e-a334-8b7e243f15bb with Priority: HIGHEST for action port [ 858.576047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.576934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.577035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.577261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.577355] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.581411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.582052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.582052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.582052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.582199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.582248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.582744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.582744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.582744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.582744] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.583503] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.583621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.583696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.583853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.583939] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e4ab4f1-01ef-431e-a334-8b7e243f15bb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.589563] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.589563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.589563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.589563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.589563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.601473] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d08516-0c16-4674-ac9d-29023bc28795 in Status: IN_PROGRESS for 2s [ 859.085665] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.085923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.086009] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.086980] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e4ab4f1-01ef-431e-a334-8b7e243f15bb with status ACTIVE [ 859.087352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.087470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.087554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.087922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.088188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.091070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.091070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.091070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.091070] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e4ab4f1-01ef-431e-a334-8b7e243f15bb is going to be updated. [ 859.109697] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.109895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.109895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.110145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.110307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.110486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e4ab4f1-01ef-431e-a334-8b7e243f15bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.395163] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-806f328e-03f8-4673-b1c0-503b3d95769c tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 859.395163] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 859.395163] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.395163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.395163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.398317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.398521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.398632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.399237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.399237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.399237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.399237] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.594076] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.889102] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.889985] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.889985] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.889985] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.891437] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.891648] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.891760] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.892510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.892510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.892510] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.892510] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.892825] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.892825] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.892825] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.892982] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.893069] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.902044] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.902235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.902314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.902567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.902654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.903249] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.903393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.903460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.903627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.903709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.903799] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e already deleted. [ 859.903916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.910481] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.910618] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.910794] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.910992] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.911316] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ac09680a-03c2-47aa-a55f-112aac7ffb32 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.911486] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.911621] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.912013] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.912199] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac09680a-03c2-47aa-a55f-112aac7ffb32',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.095543] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.095872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.095978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.096238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.096341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.096441] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 is going to be created. [ 860.118974] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.119314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.119314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.119535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.119732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.129277] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: UNINITIALIZED for 2s [ 860.416764] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.416990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.417195] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.417419] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.417569] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.417729] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ac09680a-03c2-47aa-a55f-112aac7ffb32 not found, creating... [ 860.417988] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.418156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.418395] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.418488] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.418621] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.418899] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.419095] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.419210] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.419409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.419541] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.419679] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ac09680a-03c2-47aa-a55f-112aac7ffb32 is going to be created. [ 860.445270] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.445514] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.445651] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.445930] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.446181] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.446507] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.616107] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d08516-0c16-4674-ac9d-29023bc28795 in Status: SUCCESS [ 860.616484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.804524] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9be9dceb-cb9a-4760-b357-ad4e2befbf05 None None] Enqueued Resource ID: 9992bdcc-96b5-400c-bfea-8db14b79443b with Priority: HIGHEST for action port [ 860.804524] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9992bdcc-96b5-400c-bfea-8db14b79443b with Priority: HIGHEST for action port [ 860.804524] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9992bdcc-96b5-400c-bfea-8db14b79443b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.804524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9992bdcc-96b5-400c-bfea-8db14b79443b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.804524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9992bdcc-96b5-400c-bfea-8db14b79443b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.805041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9992bdcc-96b5-400c-bfea-8db14b79443b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.805574] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9992bdcc-96b5-400c-bfea-8db14b79443b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.307589] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9992bdcc-96b5-400c-bfea-8db14b79443b [ 861.307827] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.307958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.308045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.308255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.308346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.308442] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9992bdcc-96b5-400c-bfea-8db14b79443b already deleted. [ 861.309294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9992bdcc-96b5-400c-bfea-8db14b79443b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.558315] env[69847]: INFO networking_nsxv3.common.synchronization [req-037dded7-268d-4e28-bbd9-820f3dd71f97 req-907733e1-b632-495f-b0e3-3a6492e4beb6 tempest-TenantUsagesTestJSON-1739488608 tempest-TenantUsagesTestJSON-1739488608-project-member] Enqueued Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_members [ 861.558315] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 with Priority: HIGHEST for action security_group_members [ 861.558315] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0084e13-9513-4d73-a5ee-3f7440f23dd3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.558315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.558315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.558315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.558609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.558609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.558609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.558743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.558743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.558807] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0084e13-9513-4d73-a5ee-3f7440f23dd3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.681477] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-b67ee74c-4ca5-42e7-a972-d7e293182cd0 service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 861.681758] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-b67ee74c-4ca5-42e7-a972-d7e293182cd0 service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 861.681758] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-b67ee74c-4ca5-42e7-a972-d7e293182cd0 service nova] Enqueued Resource ID: ac09680a-03c2-47aa-a55f-112aac7ffb32 with Priority: HIGHEST for action port [ 861.682383] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 861.682679] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 861.683082] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac09680a-03c2-47aa-a55f-112aac7ffb32 with Priority: HIGHEST for action port [ 861.683373] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.683518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.683584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.683836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.683917] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.685125] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.685245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.685312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.685485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.685630] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.685894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.685894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.685894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.686043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.688703] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.688703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac09680a-03c2-47aa-a55f-112aac7ffb32 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.688703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.688703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.688703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.689048] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac09680a-03c2-47aa-a55f-112aac7ffb32',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.751584] env[69847]: INFO networking_nsxv3.common.synchronization [req-2aaedc07-d708-4971-b9e1-f493e01a0f57 req-6fe74fc4-96a9-4488-87b7-b886d5f8acff tempest-ListImageFiltersTestJSON-1710148665 tempest-ListImageFiltersTestJSON-1710148665-project-member] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 861.752170] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 861.752700] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.753148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.753197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.753403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.753513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.753642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.753676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.753795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.753883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.753968] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.065434] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.065580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.065664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.065891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.065993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.066199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.066452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.066523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.066706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.066787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.066893] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 is going to be updated. [ 862.094596] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.094790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.094790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.094973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.095138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.106077] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: IN_PROGRESS for 2s [ 862.137658] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: SUCCESS [ 862.137927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.138109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.142130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.142130] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.142130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.142130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.142130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.142130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.142130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.142130] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.161316] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-c1eddca4-7557-47de-8d84-f76b69e8c230 tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 862.161794] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 862.162184] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.162285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.196838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.196838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.197301] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac09680a-03c2-47aa-a55f-112aac7ffb32 with status ACTIVE [ 862.197301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.197415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.200404] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.200404] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.200404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.200404] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac09680a-03c2-47aa-a55f-112aac7ffb32 is going to be updated. [ 862.200404] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.223204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.223398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.223495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.223770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.224589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.224589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac09680a-03c2-47aa-a55f-112aac7ffb32" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.257241] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.642429] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.662428] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.662855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.663049] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.663434] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.663646] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.664186] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.664792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.664792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.664792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.664953] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.665018] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.665155] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.665301] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.665473] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 862.665596] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.667032] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.684636] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.687023] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 862.687023] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.687023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.687023] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-538f2ac8-f9cd-40a7-8bc3-50a285a25985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.687023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.687023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.687023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.687023] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('538f2ac8-f9cd-40a7-8bc3-50a285a25985',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.704380] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.752022] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b80db492-8fc6-499c-b261-a5448d463e64 None None] Enqueued Resource ID: ca554bc3-3b30-4920-9443-b0c7357efcba with Priority: HIGHEST for action port [ 862.752022] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca554bc3-3b30-4920-9443-b0c7357efcba with Priority: HIGHEST for action port [ 862.752418] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca554bc3-3b30-4920-9443-b0c7357efcba taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.752564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca554bc3-3b30-4920-9443-b0c7357efcba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.752670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca554bc3-3b30-4920-9443-b0c7357efcba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.753678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca554bc3-3b30-4920-9443-b0c7357efcba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.753678] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca554bc3-3b30-4920-9443-b0c7357efcba',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.762015] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.147591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d83415f8-9fcd-4d12-80dc-6b4d7143c3f4: rpc.has_security_group_logging(os_id): False [ 863.173455] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.173550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.173623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.173833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.173927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.174180] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.174349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.174349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.174513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.174592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.174679] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 is going to be created. [ 863.191671] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.191961] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.192102] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.192330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.193116] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.193116] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 538f2ac8-f9cd-40a7-8bc3-50a285a25985 not found, creating... [ 863.193116] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.193501] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.193676] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.193940] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.194104] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.194392] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.195253] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.195405] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.195627] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.195766] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.195909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 538f2ac8-f9cd-40a7-8bc3-50a285a25985 is going to be created. [ 863.210547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.210694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.210772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.210966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.211071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.211219] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be created. [ 863.252202] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.252202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.252202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.252202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.252202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.252202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.254791] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca554bc3-3b30-4920-9443-b0c7357efcba [ 863.254962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.255100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.255166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.255355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.255449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.255533] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca554bc3-3b30-4920-9443-b0c7357efcba already deleted. [ 863.255611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca554bc3-3b30-4920-9443-b0c7357efcba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.264253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.264669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.264742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.264976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.265149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.269054] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.269054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.269054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.269054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.269054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.269054] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be updated. [ 863.269711] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.269826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.269885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.270074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.270233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.284206] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: UNINITIALIZED for 2s [ 863.287651] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: IN_PROGRESS for 2s [ 863.305193] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.305366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.305413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.306205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.306205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.318146] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 864.088324] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8ed93680-18c5-455e-a661-c86707e769da None None] Enqueued Resource ID: 0b814320-38b8-4a5c-a624-2f80cd17ede3 with Priority: HIGHEST for action port [ 864.088948] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b814320-38b8-4a5c-a624-2f80cd17ede3 with Priority: HIGHEST for action port [ 864.088948] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b814320-38b8-4a5c-a624-2f80cd17ede3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.090033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b814320-38b8-4a5c-a624-2f80cd17ede3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.090033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b814320-38b8-4a5c-a624-2f80cd17ede3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.090033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b814320-38b8-4a5c-a624-2f80cd17ede3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.090033] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b814320-38b8-4a5c-a624-2f80cd17ede3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.116478] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: IN_PROGRESS for 4s [ 864.410979] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-a2c34e63-14f7-457a-af33-8535f047fdf3 service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 864.411175] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-a2c34e63-14f7-457a-af33-8535f047fdf3 service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 864.411310] env[69847]: INFO networking_nsxv3.common.synchronization [req-b6038eb8-2947-47d9-8c4d-e985ac6bcfff req-a2c34e63-14f7-457a-af33-8535f047fdf3 service nova] Enqueued Resource ID: 538f2ac8-f9cd-40a7-8bc3-50a285a25985 with Priority: HIGHEST for action port [ 864.411538] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 864.411655] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 864.411750] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538f2ac8-f9cd-40a7-8bc3-50a285a25985 with Priority: HIGHEST for action port [ 864.412308] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.412413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.412597] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.414765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.414765] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-538f2ac8-f9cd-40a7-8bc3-50a285a25985 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.414765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.414765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.414765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.414765] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('538f2ac8-f9cd-40a7-8bc3-50a285a25985',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.592232] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b814320-38b8-4a5c-a624-2f80cd17ede3 [ 864.592469] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.592602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.592689] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.592871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.592989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.593086] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b814320-38b8-4a5c-a624-2f80cd17ede3 already deleted. [ 864.593176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b814320-38b8-4a5c-a624-2f80cd17ede3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.915331] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 538f2ac8-f9cd-40a7-8bc3-50a285a25985 with status ACTIVE [ 864.915604] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.915761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.915833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.916097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.916156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.916353] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.916455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.916527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.916687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.916777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.917067] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.917067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.917177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.917289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.917365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.917468] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 538f2ac8-f9cd-40a7-8bc3-50a285a25985 is going to be updated. [ 864.939509] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.939644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.939718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.939932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.940119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.940285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-538f2ac8-f9cd-40a7-8bc3-50a285a25985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.292929] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 865.293287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.293759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.294174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.294448] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.294625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.294752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.294965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.295166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.295515] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.298557] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: SUCCESS [ 865.300101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.325883] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 865.326127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.798578] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.130110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 in Status: SUCCESS [ 866.130301] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0084e13-9513-4d73-a5ee-3f7440f23dd3 deletion is rescheduled due to dependency. [ 866.130448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0084e13-9513-4d73-a5ee-3f7440f23dd3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.134556] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ff00431f-be15-4dca-924a-8bf071ca19c4 None None] Enqueued Resource ID: a3933492-0b31-479c-bcd5-77224d8bdbb1 with Priority: HIGHEST for action port [ 866.135134] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3933492-0b31-479c-bcd5-77224d8bdbb1 with Priority: HIGHEST for action port [ 866.136409] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3933492-0b31-479c-bcd5-77224d8bdbb1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.136517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3933492-0b31-479c-bcd5-77224d8bdbb1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.136619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3933492-0b31-479c-bcd5-77224d8bdbb1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.136878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3933492-0b31-479c-bcd5-77224d8bdbb1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.136962] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3933492-0b31-479c-bcd5-77224d8bdbb1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.300987] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.638808] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3933492-0b31-479c-bcd5-77224d8bdbb1 [ 866.639065] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.639200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.639264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.639470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.639563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.639655] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3933492-0b31-479c-bcd5-77224d8bdbb1 already deleted. [ 866.639734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3933492-0b31-479c-bcd5-77224d8bdbb1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.805904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.806064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.806131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.806337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.806423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.806518] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 866.834929] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.835166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.835166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.835355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.835499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.845768] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 867.181419] env[69847]: INFO networking_nsxv3.common.synchronization [None req-35bb3855-011b-4572-b3ca-cec3c59b7be8 None None] Enqueued Resource ID: a969b145-33b1-4721-908e-1bf7865b37dc with Priority: HIGHEST for action port [ 867.181419] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a969b145-33b1-4721-908e-1bf7865b37dc with Priority: HIGHEST for action port [ 867.181419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a969b145-33b1-4721-908e-1bf7865b37dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.181419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a969b145-33b1-4721-908e-1bf7865b37dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.181419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a969b145-33b1-4721-908e-1bf7865b37dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.181419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a969b145-33b1-4721-908e-1bf7865b37dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.181419] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a969b145-33b1-4721-908e-1bf7865b37dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.401832] env[69847]: INFO networking_nsxv3.common.synchronization [req-28d53013-8ba9-4ac0-92f2-e9d7b9e59c36 req-7b1857ae-7f47-42fd-b6e7-a99170712489 tempest-ServerPasswordTestJSON-568929046 tempest-ServerPasswordTestJSON-568929046-project-member] Enqueued Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_members [ 867.401832] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGHEST for action security_group_members [ 867.402859] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.404700] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.404700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.404700] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.684403] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a969b145-33b1-4721-908e-1bf7865b37dc [ 867.684761] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.684999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.684999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.684999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.684999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.686324] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a969b145-33b1-4721-908e-1bf7865b37dc already deleted. [ 867.686356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a969b145-33b1-4721-908e-1bf7865b37dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.907667] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.907667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.907667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.908076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.908076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.908403] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.908549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.908618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.908839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.909023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.909181] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d08516-0c16-4674-ac9d-29023bc28795 is going to be updated. [ 867.939736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.939736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.939736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.939736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.939929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.951233] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d08516-0c16-4674-ac9d-29023bc28795 in Status: IN_PROGRESS for 2s [ 868.857041] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.861841] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.861841] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.861841] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.861841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.861841] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.362895] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.363098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.365468] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.664465] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ddfdf881-c3c0-4101-b6d0-b7f4d1f80594 None None] Enqueued Resource ID: 2473422c-1562-4b27-b445-454f026a483a with Priority: HIGHEST for action port [ 869.665197] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2473422c-1562-4b27-b445-454f026a483a with Priority: HIGHEST for action port [ 869.665617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2473422c-1562-4b27-b445-454f026a483a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.665923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2473422c-1562-4b27-b445-454f026a483a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.666743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2473422c-1562-4b27-b445-454f026a483a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.667629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2473422c-1562-4b27-b445-454f026a483a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.667904] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2473422c-1562-4b27-b445-454f026a483a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.867725] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.961730] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d08516-0c16-4674-ac9d-29023bc28795 in Status: SUCCESS [ 869.961730] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d08516-0c16-4674-ac9d-29023bc28795 deletion is rescheduled due to dependency. [ 869.961730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.173850] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2473422c-1562-4b27-b445-454f026a483a [ 870.174191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.174310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.174381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.174587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.174677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.174770] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2473422c-1562-4b27-b445-454f026a483a already deleted. [ 870.174850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2473422c-1562-4b27-b445-454f026a483a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.377522] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.377683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.377756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.377972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.378084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.378182] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 870.408987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.408987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.408987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.408987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.408987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.420519] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 871.332129] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 871.332397] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:1 started [ 872.435184] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 872.436179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.436685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.437500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.437500] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.437500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.438707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.438861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.439011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.439131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.439374] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.439545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.439636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.439853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.440565] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.440565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.440565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.440565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.440565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.440565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.440816] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.943436] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72471c75-08a5-45be-9362-d9463542469e: rpc.has_security_group_logging(os_id): False [ 872.962603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.962603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.962603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.962603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.963504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.963504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.963504] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.963504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.963504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.963504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.963504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.963888] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be created. [ 873.018379] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.020117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.022152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.022418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.023111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.033767] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 873.278038] env[69847]: INFO networking_nsxv3.common.synchronization [None req-98835024-474e-494f-8517-8981c07b18af None None] Enqueued Resource ID: 2da0fbc4-fef7-4ffe-ac45-4428c001ce05 with Priority: HIGHEST for action port [ 873.278193] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2da0fbc4-fef7-4ffe-ac45-4428c001ce05 with Priority: HIGHEST for action port [ 873.283246] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2da0fbc4-fef7-4ffe-ac45-4428c001ce05 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.283246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2da0fbc4-fef7-4ffe-ac45-4428c001ce05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.283246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2da0fbc4-fef7-4ffe-ac45-4428c001ce05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.283246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2da0fbc4-fef7-4ffe-ac45-4428c001ce05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.283246] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2da0fbc4-fef7-4ffe-ac45-4428c001ce05',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.485488] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4687bdb2-6e4d-4169-b8fd-f59712158dec None None] Enqueued Resource ID: 3e911420-d86d-45a4-90e2-7b449a42574e with Priority: HIGHEST for action port [ 873.487041] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e911420-d86d-45a4-90e2-7b449a42574e with Priority: HIGHEST for action port [ 873.487041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e911420-d86d-45a4-90e2-7b449a42574e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.487041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e911420-d86d-45a4-90e2-7b449a42574e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.487041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e911420-d86d-45a4-90e2-7b449a42574e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.490713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e911420-d86d-45a4-90e2-7b449a42574e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.490713] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e911420-d86d-45a4-90e2-7b449a42574e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.785257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2da0fbc4-fef7-4ffe-ac45-4428c001ce05 [ 873.785257] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.785257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.785257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.785257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.785520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.785520] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2da0fbc4-fef7-4ffe-ac45-4428c001ce05 already deleted. [ 873.785520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2da0fbc4-fef7-4ffe-ac45-4428c001ce05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.969659] env[69847]: INFO networking_nsxv3.common.synchronization [None req-fbf51fe0-122e-4da8-83d2-c78293cc6d62 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_rules [ 873.969659] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_rules [ 873.969659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.970164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.970387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.970768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.970970] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.994372] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e911420-d86d-45a4-90e2-7b449a42574e [ 873.994372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.994372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.994372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.994613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.994613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.994707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e911420-d86d-45a4-90e2-7b449a42574e already deleted. [ 873.994749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e911420-d86d-45a4-90e2-7b449a42574e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.117979] env[69847]: INFO networking_nsxv3.common.synchronization [None req-2f1a5e0c-f55c-419f-b10e-ae9734ac64e8 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_rules [ 874.119502] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_rules [ 874.119502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.119502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.493700] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.493700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.493700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.493700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.493700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.493700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 already deleted. [ 874.493700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.494129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.494129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.494129] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.982550] env[69847]: INFO networking_nsxv3.common.synchronization [None req-696f21d0-a1c0-4ffa-825d-501ce0c2cdaf tempest-ServerActionsV293TestJSON-414194083 tempest-ServerActionsV293TestJSON-414194083-project-member] Enqueued Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_rules [ 874.983100] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_rules [ 874.983407] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.983522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.983690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.983889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.983969] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.016984] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.017220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.017275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.017505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.017632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.017750] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 already deleted. [ 875.017890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.043858] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 875.043968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.044121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.044822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.044822] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.109446] env[69847]: INFO networking_nsxv3.common.synchronization [None req-aed5f2a8-964b-4a22-9b7e-8180e493d05d tempest-ServerActionsV293TestJSON-414194083 tempest-ServerActionsV293TestJSON-414194083-project-member] Enqueued Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_rules [ 875.109995] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_rules [ 875.110377] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.110479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.505874] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.506451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.506451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.506451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.506451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.506451] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d already deleted. [ 875.506451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.506798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.506798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.508336] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.551038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.551193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.551193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.551495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.552322] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.552322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.552322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.552322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.552322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.552322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.552322] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.650475] env[69847]: INFO networking_nsxv3.common.synchronization [None req-5b60d8c5-6555-4ce8-b86d-133fb10b53a0 None None] Enqueued Resource ID: b8a09c3c-7e47-46e3-9596-633cdfede346 with Priority: HIGHEST for action port [ 875.651808] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a09c3c-7e47-46e3-9596-633cdfede346 with Priority: HIGHEST for action port [ 875.651808] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8a09c3c-7e47-46e3-9596-633cdfede346 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.651808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8a09c3c-7e47-46e3-9596-633cdfede346" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.651808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8a09c3c-7e47-46e3-9596-633cdfede346" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.651808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8a09c3c-7e47-46e3-9596-633cdfede346" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.651808] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a09c3c-7e47-46e3-9596-633cdfede346',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.749070] env[69847]: INFO networking_nsxv3.common.synchronization [req-813cae3e-6f2f-48b7-836c-a5a293e40c84 req-f57d1808-e4ae-4f5f-9059-a6ef143d225a tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 875.749271] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 875.749659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.749659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.749806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.749976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.755019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.755019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.755019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.755019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.755019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.755019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.904101] env[69847]: INFO networking_nsxv3.common.synchronization [None req-1a179926-fca0-47ac-ac28-bc7e0fb5be52 None None] Enqueued Resource ID: da2d7232-f7e8-47db-bc40-aca20ebe7a8b with Priority: HIGHEST for action port [ 875.904668] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da2d7232-f7e8-47db-bc40-aca20ebe7a8b with Priority: HIGHEST for action port [ 875.905556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-da2d7232-f7e8-47db-bc40-aca20ebe7a8b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.905687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da2d7232-f7e8-47db-bc40-aca20ebe7a8b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.905749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da2d7232-f7e8-47db-bc40-aca20ebe7a8b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.906453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da2d7232-f7e8-47db-bc40-aca20ebe7a8b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.906453] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da2d7232-f7e8-47db-bc40-aca20ebe7a8b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.034449] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.035564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.035800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.036818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.036818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.036818] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d already deleted. [ 876.036818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.054622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.054860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.058093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.058093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.058093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.058093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.058918] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.157444] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8a09c3c-7e47-46e3-9596-633cdfede346 [ 876.157686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.157818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.157887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.158113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.158207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.158298] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8a09c3c-7e47-46e3-9596-633cdfede346 already deleted. [ 876.158377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8a09c3c-7e47-46e3-9596-633cdfede346" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.178887] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.178887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.178887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.179792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.179792] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.179792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.179792] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.179971] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.179971] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.180260] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.180490] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.180490] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.180594] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.180760] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.180818] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.181015] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.198309] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.198516] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.199881] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.199881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.199881] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-c21e37b5-ee8b-4194-96ea-0666f553991c taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.199881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.199881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.199881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.199881] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21e37b5-ee8b-4194-96ea-0666f553991c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.255714] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.409364] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da2d7232-f7e8-47db-bc40-aca20ebe7a8b [ 876.410191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.410191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.410191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.410191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.410191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.410191] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da2d7232-f7e8-47db-bc40-aca20ebe7a8b already deleted. [ 876.410473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da2d7232-f7e8-47db-bc40-aca20ebe7a8b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.561823] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72471c75-08a5-45be-9362-d9463542469e: rpc.has_security_group_logging(os_id): False [ 876.580204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.580526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.580526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.580833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.580983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.581314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.581438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.581630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.581696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.581755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.581920] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.582921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.583225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.583225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.583351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.583474] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.583573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.583626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.583769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.583845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.583929] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 876.618885] env[69847]: INFO networking_nsxv3.common.synchronization [req-40d41265-5e2a-4b81-9769-57dca4c518c5 req-a5170702-4e03-412e-9868-3a4c1f219d41 tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 876.619758] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 876.620117] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.620314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.620314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.620492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.620638] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.620751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.620845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.620925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.621049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.621105] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.639175] env[69847]: INFO networking_nsxv3.common.synchronization [req-5ed294b1-2cc3-4340-bf5a-19749c3f7249 req-67ef915c-03de-475b-8c85-f35e2b7ec877 tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 876.640337] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.640463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.640623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.640728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.640856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.643287] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 876.644349] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.644440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.655473] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 876.702582] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.702822] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.702951] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.703271] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.703498] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.703577] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port c21e37b5-ee8b-4194-96ea-0666f553991c not found, creating... [ 876.703906] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.704018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.704106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.704666] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.704666] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.704830] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.704928] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.705015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.710558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.710558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.710558] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: c21e37b5-ee8b-4194-96ea-0666f553991c is going to be created. [ 876.731633] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.731959] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.732234] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.732677] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.733049] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.733539] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.757924] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.124482] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.124751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.124751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.124967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.125039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.125364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.125470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.125544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.125708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.125800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.125890] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 877.152224] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.152360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.152796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.152796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.152796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.163699] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 877.260055] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.260288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.260357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.260582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.260680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.260779] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 877.289258] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.289406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.289451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.289880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.289880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.304873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 877.478933] env[69847]: INFO networking_nsxv3.common.synchronization [req-813cae3e-6f2f-48b7-836c-a5a293e40c84 req-9bc3d106-67a1-40e7-9b2b-39ee7ede15b0 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 877.479129] env[69847]: INFO networking_nsxv3.common.synchronization [req-813cae3e-6f2f-48b7-836c-a5a293e40c84 req-9bc3d106-67a1-40e7-9b2b-39ee7ede15b0 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 877.479270] env[69847]: INFO networking_nsxv3.common.synchronization [req-813cae3e-6f2f-48b7-836c-a5a293e40c84 req-9bc3d106-67a1-40e7-9b2b-39ee7ede15b0 service nova] Enqueued Resource ID: c21e37b5-ee8b-4194-96ea-0666f553991c with Priority: HIGHEST for action port [ 877.479501] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 877.479628] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 877.479721] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c21e37b5-ee8b-4194-96ea-0666f553991c with Priority: HIGHEST for action port [ 877.480541] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.480632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.480696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.480894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.480982] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.482047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.482047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.482047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c21e37b5-ee8b-4194-96ea-0666f553991c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.482228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.482276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.482418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.482486] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21e37b5-ee8b-4194-96ea-0666f553991c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.984072] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.984398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.984398] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c21e37b5-ee8b-4194-96ea-0666f553991c with status ACTIVE [ 877.984600] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.984696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.984763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.984961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.985060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.985227] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.985322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.985372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.985526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.985602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.985781] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.985870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.985928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.986087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.986161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.986241] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c21e37b5-ee8b-4194-96ea-0666f553991c is going to be updated. [ 878.009351] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.009471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.009471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.009775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.009856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.010506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c21e37b5-ee8b-4194-96ea-0666f553991c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.669046] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 878.669281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.171990] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 879.172249] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e deletion is rescheduled due to dependency. [ 879.172372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.172520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.172727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.172905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.173033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.173147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.173330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.173401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.173495] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.316040] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.316040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.316040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.316040] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.676790] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.676972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.677053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.677313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.677396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.677573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.677658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.677766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.677872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.677921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.677996] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 879.713861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.714157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.714157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.714402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.714458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.723021] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 879.818498] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.033212] env[69847]: INFO networking_nsxv3.common.synchronization [req-d37a0100-5153-4946-88b6-6b958f00f20a req-088b208f-3a67-4f42-a558-05390a3caeee tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 880.034262] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 880.038901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.038901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.038901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.038901] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.321242] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.385263] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.385478] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.385693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.385949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.386237] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.386481] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.386549] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.386947] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.387157] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.387391] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.387525] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.387637] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.387747] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.387872] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.387983] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.388145] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.408913] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.410153] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 880.410153] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.410302] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.410617] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-1063271a-1f5a-4abc-8b02-74e05242bda8 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.410862] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.411042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.411426] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.411604] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1063271a-1f5a-4abc-8b02-74e05242bda8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.540804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.540957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.541045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.541254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.541339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.541555] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.541619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.541681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.541829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.541904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.541986] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa already deleted. [ 880.542083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.823578] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.823733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.823808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.824039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.824134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.824236] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 880.851993] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.852200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.852279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.852482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.852626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.861106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 880.914443] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.914640] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.914799] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.915221] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.915451] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 1063271a-1f5a-4abc-8b02-74e05242bda8 not found, creating... [ 880.916027] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.916245] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.916245] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.916774] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.916774] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916964] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.917178] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.917425] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.917694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.918374] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.918562] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 1063271a-1f5a-4abc-8b02-74e05242bda8 is going to be created. [ 880.944978] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.944978] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.944978] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.944978] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.944978] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.944978] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.668983] env[69847]: INFO networking_nsxv3.common.synchronization [req-d37a0100-5153-4946-88b6-6b958f00f20a req-92b8bd28-9ac3-430a-86c0-f8fa3d996cb2 service nova] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_rules [ 881.669319] env[69847]: INFO networking_nsxv3.common.synchronization [req-d37a0100-5153-4946-88b6-6b958f00f20a req-92b8bd28-9ac3-430a-86c0-f8fa3d996cb2 service nova] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 881.669383] env[69847]: INFO networking_nsxv3.common.synchronization [req-d37a0100-5153-4946-88b6-6b958f00f20a req-92b8bd28-9ac3-430a-86c0-f8fa3d996cb2 service nova] Enqueued Resource ID: 1063271a-1f5a-4abc-8b02-74e05242bda8 with Priority: HIGHEST for action port [ 881.669566] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_rules [ 881.669692] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 881.669845] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1063271a-1f5a-4abc-8b02-74e05242bda8 with Priority: HIGHEST for action port [ 881.670450] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.670560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.670623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.671023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.671140] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.672055] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.672191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.672239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.672954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.672954] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.672954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.672954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.672954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.672954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.673509] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.674024] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1063271a-1f5a-4abc-8b02-74e05242bda8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.674024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.674024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.674273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.675194] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1063271a-1f5a-4abc-8b02-74e05242bda8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.733037] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 881.733037] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e deletion is rescheduled due to dependency. [ 881.733037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.176215] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.176343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.176554] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.177580] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1063271a-1f5a-4abc-8b02-74e05242bda8 with status ACTIVE [ 882.177838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.177973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.177973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.178183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.178262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.178449] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.178572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.178657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.178864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.178943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.179160] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.179299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.179357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.179521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.179593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.179855] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1063271a-1f5a-4abc-8b02-74e05242bda8 is going to be updated. [ 882.204142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.204312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.204366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.204561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.204695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.204855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1063271a-1f5a-4abc-8b02-74e05242bda8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.681606] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.873946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 882.874211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.874379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.874599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.874792] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.874906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.874971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.875138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.875219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.875301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.875391] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.184278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.184445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.184524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.184745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.184849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.184948] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be created. [ 883.233245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.233379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.233461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.233677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.233877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.247388] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: UNINITIALIZED for 2s [ 883.380025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.380025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.380025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.380025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.380025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.380025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.380025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.380375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.380375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.380375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.380469] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.380568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.380631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.380770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.380908] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.380998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.381087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.381228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.381303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.381442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.381488] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.886727] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 883.903335] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.903516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.903516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.903789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.903872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.903991] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.904110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.904162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.904307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.904383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.904581] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.904673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.904738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.904871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.904935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.905135] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.905224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.905280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.905421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.905496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.905579] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 883.964750] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.964889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.964958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.965182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.965327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.976813] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 885.256837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 885.257152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.257323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.257788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.257858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.257976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.258075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.258261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.258349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.258453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.258548] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.761648] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.761811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.761811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.762058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.762301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.762408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.762473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.762636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.762726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.762814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.762961] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.763096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.763129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.763320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.763479] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.763571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.763630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.763769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.763867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.763919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.764008] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.994037] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 885.994777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.267099] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ebba71e-a742-472f-8890-25c0bf66f3fa: rpc.has_security_group_logging(os_id): False [ 886.283034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.283034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.283034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.283346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.283346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.283439] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.283537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.283762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.283762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.283882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.284062] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.284156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.284217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.284384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.284428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.284617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.284749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.284749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.285182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.285182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.285182] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be created. [ 886.286274] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.286572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.286760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.286821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.286915] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.343707] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.344236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.344319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.344538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.344969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.360842] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 886.671209] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 886.671319] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 886.791201] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.292978] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.795657] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 887.795776] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 887.868521] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f06dd2f-6860-4655-a848-e2dcc1f67346 req-9508dc3a-0d23-4d10-aed9-9c5a64f7fb31 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 887.868781] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 887.869085] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.869205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.869272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.869515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.869628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.869723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.869785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.869920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.870010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.870118] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.372481] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.376989] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 888.378175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.680740] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.680883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.680947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.681268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.699227] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 888.700506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.701573] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 888.740843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.740843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.740843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.740843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.745655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.749699] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 888.749792] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 888.749882] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 888.783022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.783022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.783022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.783022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.784170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.784270] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 888.834061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.834208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.834301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.834484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.834727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.834925] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 888.877433] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.887049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.887219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.887284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.887442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.887662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.887871] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 888.887959] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f78c8839-8143-4fa9-8d9a-46b39052b3a4', '4359fdeb-9904-4f7c-a575-f7f2e7d70d6c', '39c88011-49df-4c92-a73f-ef1e67d3d9e4', '447511d4-51f2-4b25-94d1-cdabf552a536', '6e7f5569-d370-40fa-81c6-135bdeca6427', '4cf3bdf1-5c54-495f-8312-720bf2e26ee0', '4ebba71e-a742-472f-8890-25c0bf66f3fa', 'b495386a-9f65-4bd6-a72b-2cc4c5b333fe', 'f9b9bce3-208c-4b60-a51a-b29860fe98d3', '3f046260-8d14-4c53-95c0-038d4be520e2', 'd83415f8-9fcd-4d12-80dc-6b4d7143c3f4', '5fa7dd18-0289-4c11-8f13-4837e0914735', '0e7c8712-c7ea-4340-b068-333e83abf23f', '10d780d9-da02-40c2-90cc-6f3fac7afc1f', '3ea12339-45c6-49af-909a-f5d031f10029', 'def2b8bf-1a3c-42a9-ba24-20811016588c', 'b8f57242-fc73-4330-af5c-da599a57f0de', '804e0265-2d3b-49e8-899e-80d4d047aae0', '342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d', '67647cd6-2025-4b5b-831e-5ac3f961ef45', '72471c75-08a5-45be-9362-d9463542469e', 'e1f264c4-f165-4427-b9e3-23d05179073b', '2390abe6-0ba8-4ab0-8c91-187bd39ef80c', '3c88aae7-5837-4451-89b6-8972ab00f699', 'de342dad-fb8d-4c7b-87ea-595f01e3c6be', '8982c0b6-8a83-4e29-82e9-02c4a6ebebad', 'bd9acc22-8a8b-484a-8e94-b168c183d5d8', 'd49fbfa3-cbed-486e-8169-864e1a046ae7', '39d08516-0c16-4674-ac9d-29023bc28795', '8022d569-fc48-4639-a726-38e4b078eac1', '9adcb44b-15db-439a-8e0e-af687bcfa50b', 'a895e100-517f-40a3-99b4-4b43ee1bd032', '2b2d82cb-7e65-491f-8df0-d52a50997ba5', '538bdf43-fa07-48d1-906e-f7fa68a3a739', 'd0084e13-9513-4d73-a5ee-3f7440f23dd3', '598796a3-3295-47ec-afb1-170cde7401b5'} {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 888.888844] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 888.908801] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.909779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.909779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.909909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.909909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.909978] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 888.910123] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 888.910162] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 888.969890] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.970056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.970113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.970318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.971018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.971268] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 888.971347] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 888.971421] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 888.971482] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 888.971569] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 888.972357] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGH for action security_group_rules [ 888.972528] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGH for action security_group_rules [ 888.972528] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGH for action security_group_rules [ 888.972731] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGH for action security_group_rules [ 888.972731] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGH for action security_group_rules [ 888.972731] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGH for action security_group_rules [ 888.972731] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGH for action security_group_rules [ 888.972891] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGH for action security_group_rules [ 888.972891] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGH for action security_group_rules [ 888.972891] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGH for action security_group_rules [ 888.972980] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGH for action security_group_rules [ 888.973026] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGH for action security_group_rules [ 888.973130] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGH for action security_group_rules [ 888.973130] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGH for action security_group_rules [ 888.973244] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGH for action security_group_rules [ 888.973244] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGH for action security_group_rules [ 888.973344] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGH for action security_group_rules [ 888.973394] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGH for action security_group_rules [ 888.973444] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGH for action security_group_rules [ 888.973496] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGH for action security_group_rules [ 888.973560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.379716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.379980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.379980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.380169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.380219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.380322] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 889.406037] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.406202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.406273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.406476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.406656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.416264] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 890.968777] env[69847]: INFO networking_nsxv3.common.synchronization [req-5a4b2c8c-8078-48d0-bbe7-ba7011a1d284 req-980e19c7-c605-4433-b797-104a048a387e tempest-ServersWithSpecificFlavorTestJSON-1036324866 tempest-ServersWithSpecificFlavorTestJSON-1036324866-project-member] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 890.969607] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 890.969607] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGH for action security_group_rules [ 890.969607] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGH for action security_group_rules [ 890.970711] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea12339-45c6-49af-909a-f5d031f10029 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f046260-8d14-4c53-95c0-038d4be520e2 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGH for action security_group_rules [ 890.972048] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 with Priority: HIGH for action security_group_rules [ 890.972829] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c with Priority: HIGH for action security_group_rules [ 890.972829] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGH for action security_group_rules [ 890.972829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.972829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.972829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.973116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.973116] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.973116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.973229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.973298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.973369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.973463] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.974640] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.974640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.974640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.974827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.974865] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.975580] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.975685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.975750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.975932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.976051] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.976728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.976848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.976925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.977042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.977107] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.978243] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ea12339-45c6-49af-909a-f5d031f10029 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.978345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.978412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.978564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.978638] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ea12339-45c6-49af-909a-f5d031f10029',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.979539] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67647cd6-2025-4b5b-831e-5ac3f961ef45 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.979610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.979679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.979827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.979898] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67647cd6-2025-4b5b-831e-5ac3f961ef45',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.981131] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.981281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.981333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.981967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.981967] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.983300] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.983300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.983300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.983300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.983300] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.983551] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.983655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.983720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.983871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.983965] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.984746] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.984873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.984932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.985073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.985200] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10d780d9-da02-40c2-90cc-6f3fac7afc1f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.986115] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.986115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.986261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.986319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.986425] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.987189] env[69847]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 890.987372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.987470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.987537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.987687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.987935] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.989988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.989988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.989988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.989988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.989988] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.990633] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.990778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.990847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.991007] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.991132] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.991855] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f046260-8d14-4c53-95c0-038d4be520e2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.991960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.992040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.992192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.992290] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f046260-8d14-4c53-95c0-038d4be520e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.993072] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.993179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.993256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.993416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.993492] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b9bce3-208c-4b60-a51a-b29860fe98d3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.994350] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.994448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.994513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.994680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.994761] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cf3bdf1-5c54-495f-8312-720bf2e26ee0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.995579] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.995685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.995750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.995897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.995964] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.996748] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e7f5569-d370-40fa-81c6-135bdeca6427 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.996847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.996913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.997079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.997150] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e7f5569-d370-40fa-81c6-135bdeca6427',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.998008] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.998121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.998186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.998335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.998408] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4359fdeb-9904-4f7c-a575-f7f2e7d70d6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.999191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.999282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.999347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.999497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.999569] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.999779] env[69847]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 891.307021] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.307258] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.307395] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.308018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.308476] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.308662] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.308814] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.309145] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.311912] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.311912] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.311912] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.311912] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.311912] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.311912] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.311912] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.311912] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.331714] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.331894] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.332050] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.332305] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-797" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.332780] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f47baaf8-240b-4bea-831c-609ffa538cd7 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.332901] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.332961] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.333435] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.333601] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47baaf8-240b-4bea-831c-609ffa538cd7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.432622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 891.432874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.501669] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.501897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.501897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.502185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.503757] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.503897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.503960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.504111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.504367] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.504367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.504484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.504591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.504649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.504712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.504801] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.506140] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.506140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.506140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.506140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.506378] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.506378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.506378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.506483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.506527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.507281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.507281] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.521777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.522057] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.522189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.522306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.522865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.522865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.522865] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be updated. [ 891.527327] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.527456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.527558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.527714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.527869] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.528031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.528031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.528176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.528311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.528346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.528414] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.529868] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.529988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.530068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.530272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.530424] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.530520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.530580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.530724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.530802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.530884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.530990] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.536889] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.537256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.537256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.537405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.537497] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.537694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.537694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.537816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.537869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.537944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.538040] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.543996] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.543996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.543996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.544167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.544247] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.544336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.544398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.544592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.544644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.544839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.544839] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.547233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.547233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.547233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.547233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.547233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.547233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.547233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.547233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.547656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.547656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.547656] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.550102] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.550232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.550332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.550534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.550672] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.550782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.550844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.552029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.552029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.552029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.552029] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.553507] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.553630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.554460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.554460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.554460] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.554460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.554460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.554460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.554795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.554795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.554795] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.559023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.559161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.559292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.559461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.559607] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.560028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.560110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.560315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.560315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.560442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.560514] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.567905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.567905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.568105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.568167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.568307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.606262] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.606441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.606512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.606726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.608590] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.608699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.609420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.609514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.610278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.610373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.611087] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.611178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.611874] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.611966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.612601] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: IN_PROGRESS for 2s [ 891.613391] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.613482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.614155] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.614248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.614898] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.614988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.615759] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.615846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.633170] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 891.633724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.633868] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10d780d9-da02-40c2-90cc-6f3fac7afc1f is going to be deleted. [ 891.634911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.635141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.653351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.653504] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67647cd6-2025-4b5b-831e-5ac3f961ef45 is going to be deleted. [ 891.654311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.654526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.679584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.679741] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b9bce3-208c-4b60-a51a-b29860fe98d3 is going to be deleted. [ 891.680734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.680932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.692785] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.692911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.699043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.699188] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be deleted. [ 891.700107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.700332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.710018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.710157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.717085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.717213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ea12339-45c6-49af-909a-f5d031f10029 is going to be deleted. [ 891.718438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.718650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.752355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.752504] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be deleted. [ 891.753470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.753682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.787533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.787748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.801327] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.801482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.803826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.803929] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4359fdeb-9904-4f7c-a575-f7f2e7d70d6c is going to be deleted. [ 891.804812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.805042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.837673] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.837918] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.838064] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.838359] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.838515] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.838674] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f47baaf8-240b-4bea-831c-609ffa538cd7 not found, creating... [ 891.838940] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.839114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.839233] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.839452] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.839591] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.839867] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.840031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.840151] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.840404] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.840528] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.840661] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f47baaf8-240b-4bea-831c-609ffa538cd7 is going to be created. [ 891.853712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.853942] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e7f5569-d370-40fa-81c6-135bdeca6427 is going to be deleted. [ 891.854954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.855205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.874033] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.874271] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.874402] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.874710] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.874938] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.875202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.902421] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.902572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.904464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.904607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.911969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.912109] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cf3bdf1-5c54-495f-8312-720bf2e26ee0 is going to be deleted. [ 891.913080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.913290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.949591] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.949716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.977671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.978012] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f046260-8d14-4c53-95c0-038d4be520e2 is going to be deleted. [ 891.978741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.978955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.979057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.979178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10d780d9-da02-40c2-90cc-6f3fac7afc1f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.979340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.979488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.979567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.979683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67647cd6-2025-4b5b-831e-5ac3f961ef45" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.980203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.980411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.980510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.980671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b9bce3-208c-4b60-a51a-b29860fe98d3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.980809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.980959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.981048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.981161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.981294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.981437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.981514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.981624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ea12339-45c6-49af-909a-f5d031f10029" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.981746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.981887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.981962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.982089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.982219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.982423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.982525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.982671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4359fdeb-9904-4f7c-a575-f7f2e7d70d6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.005484] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.005618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.005693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.005870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.005958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.006088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e7f5569-d370-40fa-81c6-135bdeca6427" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.008538] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.009534] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.017338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.017553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.017676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.017952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.018120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.018296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cf3bdf1-5c54-495f-8312-720bf2e26ee0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.030274] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.030274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.030453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.030529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.030687] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.030783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.030845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.030987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.031098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.031196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.031345] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.031437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.031494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.031633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.031764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.031851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.031908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.032052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.032189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.032323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.032395] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.033486] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.040778] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.040936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.040998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.043073] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.043073] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.043073] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.043073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.043073] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.047407] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.048834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.048957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.049384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.049486] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.049634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.049634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.050339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.050339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.050339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.050339] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.050339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.050339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.050722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.050722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.050722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.050722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.051064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.051064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.051064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.051064] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.052871] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.053622] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.056414] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.062992] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.062992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.062992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.063436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.063624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.063745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.064430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.064430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.064430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.064430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.064430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.064702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.064702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.064702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.064804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.064972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.065077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.065263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.065381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.065786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.065786] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.147470] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.147470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.147470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.147470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.147470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.147778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f046260-8d14-4c53-95c0-038d4be520e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.512428] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39c88011-49df-4c92-a73f-ef1e67d3d9e4: rpc.has_security_group_logging(os_id): False [ 892.513700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f78c8839-8143-4fa9-8d9a-46b39052b3a4: rpc.has_security_group_logging(os_id): False [ 892.532512] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.532512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.532512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.532752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.534162] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.534286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.534468] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 892.539381] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 804e0265-2d3b-49e8-899e-80d4d047aae0: rpc.has_security_group_logging(os_id): False [ 892.545185] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ebba71e-a742-472f-8890-25c0bf66f3fa: rpc.has_security_group_logging(os_id): False [ 892.554091] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.554286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.554456] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d83415f8-9fcd-4d12-80dc-6b4d7143c3f4: rpc.has_security_group_logging(os_id): False [ 892.555975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.556236] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.556368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.556368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.556554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.556637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.556729] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 is going to be updated. [ 892.558631] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.558775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.559272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.559272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.559944] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d: rpc.has_security_group_logging(os_id): False [ 892.560696] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7c8712-c7ea-4340-b068-333e83abf23f: rpc.has_security_group_logging(os_id): False [ 892.561489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for def2b8bf-1a3c-42a9-ba24-20811016588c: rpc.has_security_group_logging(os_id): False [ 892.563174] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.563174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.569033] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fa7dd18-0289-4c11-8f13-4837e0914735: rpc.has_security_group_logging(os_id): False [ 892.576705] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.576841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.579386] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.579502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.581252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.581659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.581659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.581659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.581849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.581899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.582489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be updated. [ 892.583556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.583644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.583715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.583884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.585431] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.585527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.586188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.586275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.608022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.608022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.608022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.608022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.608022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.608022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.608022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c is going to be updated. [ 892.608022] env[69847]: INFO networking_nsxv3.common.synchronization [req-5a4b2c8c-8078-48d0-bbe7-ba7011a1d284 req-b553b013-3e8a-4b45-ac8d-5867b4f23ce8 service nova] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 892.608022] env[69847]: INFO networking_nsxv3.common.synchronization [req-5a4b2c8c-8078-48d0-bbe7-ba7011a1d284 req-b553b013-3e8a-4b45-ac8d-5867b4f23ce8 service nova] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 892.608022] env[69847]: INFO networking_nsxv3.common.synchronization [req-5a4b2c8c-8078-48d0-bbe7-ba7011a1d284 req-b553b013-3e8a-4b45-ac8d-5867b4f23ce8 service nova] Enqueued Resource ID: f47baaf8-240b-4bea-831c-609ffa538cd7 with Priority: HIGHEST for action port [ 892.608629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.608807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.609943] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_rules [ 892.610088] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 892.610186] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f47baaf8-240b-4bea-831c-609ffa538cd7 with Priority: HIGHEST for action port [ 892.611001] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.611182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.611238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.611479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.611479] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.613308] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.613444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.613601] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f47baaf8-240b-4bea-831c-609ffa538cd7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.613716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.614839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.614839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.614839] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f47baaf8-240b-4bea-831c-609ffa538cd7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.633510] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.633676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.637376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.637629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.637742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.637808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.638015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.638101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.638287] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.638385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.638447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.638592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.638666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.638840] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.638918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.638979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.639134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.639208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.639295] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 892.640519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.640677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.642575] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.642575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.656770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.657028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.657149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.657215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.657409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.657492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.657678] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.657779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.657837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.657977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.658059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.658251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.658328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.658384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.658522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.658597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.658684] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be updated. [ 892.660244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.660361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.669547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.669681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.683021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.683111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.683195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.683251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.683406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.683488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.683689] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.683800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.683859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.683994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.684082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.684257] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.684336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.684394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.684533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.684629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.684722] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 892.685844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.686120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.711499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.711832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.711931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.711998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.712203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.712397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.712467] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 is going to be updated. [ 892.714149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.714387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.714546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.715524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.715602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.717190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.717292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.744165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.744459] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.744615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.744615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.745292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.745292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.745292] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 is going to be updated. [ 892.746514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.746514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.748087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: IN_PROGRESS for 2s [ 892.778440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.778563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.794828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.794828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.812045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.812045] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.812045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.812045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.812375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.812375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.812576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.812677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.812735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.812895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.812970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.813172] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.813257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.813327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.813528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.813528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.813622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be updated. [ 892.814683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.814854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.859333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.859507] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.878931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.879402] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.879498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.879560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.879964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.879964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.879964] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 892.881651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.881841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.881996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.883065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.883237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.883400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.884332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.884610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.884753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.888064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.888064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.888064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.888064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.888064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.888064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.888431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.888627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.888720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.910526] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.910659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.910724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.910904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.911047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.937081] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 892.939156] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.939322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.939322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.939626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.939847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.941526] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 892.942244] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: IN_PROGRESS for 2s [ 892.942837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: IN_PROGRESS for 2s [ 892.943730] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 892.946850] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 892.947429] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: IN_PROGRESS for 2s [ 892.966363] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 893.027791] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.028245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.028245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.028486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.028486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.041322] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 893.115979] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.116134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.116333] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f47baaf8-240b-4bea-831c-609ffa538cd7 with status ACTIVE [ 893.116507] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.116603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.116669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.116886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.116975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.117190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.117285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.117332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.118491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.118491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.118491] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.118491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.118491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.118491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.118491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.118491] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f47baaf8-240b-4bea-831c-609ffa538cd7 is going to be updated. [ 893.146585] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.146728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.146782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.146994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.147146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.147303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f47baaf8-240b-4bea-831c-609ffa538cd7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.621509] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 893.621673] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c deletion is rescheduled due to dependency. [ 893.621787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.621940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.622164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.622395] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.622504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.622568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.622735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.622812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.622904] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.125015] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.627475] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.648800] env[69847]: INFO networking_nsxv3.common.synchronization [req-95531152-2122-4b56-ac09-3561bc48d3ca req-02cc14c9-4e4c-4051-9467-b7a3aecc7d22 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 894.649351] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 894.649678] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.649799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.649861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.650838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.651044] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.651322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.651322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.651422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.651486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.651578] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.761970] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: SUCCESS [ 894.762213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.947740] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.947847] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.948096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.948412] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.948814] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.949061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.949199] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.949433] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.949584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.949792] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.949908] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.950023] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.950154] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.950232] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.950374] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.950522] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.953889] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 894.954230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.956879] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 894.957094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.964569] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: SUCCESS [ 894.964836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.968900] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 894.968954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.971738] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: SUCCESS [ 894.971837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.972596] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 894.972702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.973321] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: SUCCESS [ 894.973485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.977142] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.977308] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.977450] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.977611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-547" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.978198] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.978198] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.978198] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.978532] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.978674] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff6548c-7043-496b-8a2b-7a622dd2ef6a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.979908] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 894.980092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.054837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 895.055159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.130847] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.130847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.130847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.130847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.131299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.131299] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be updated. [ 895.153937] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.158095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.158095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.158095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.158095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.158095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.165651] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: IN_PROGRESS for 2s [ 895.484339] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.484586] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.484744] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.485047] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.485208] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.485369] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 2ff6548c-7043-496b-8a2b-7a622dd2ef6a not found, creating... [ 895.485641] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.485802] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.485920] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.486162] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.486303] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.486587] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.486744] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.486861] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.487079] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.487216] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.487358] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a is going to be created. [ 895.506666] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.506838] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.506958] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.507215] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.507460] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.507679] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.656366] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.158713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.160864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.160999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.161262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.161363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.161472] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 896.201795] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.201952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.202239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.202239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.202415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.210973] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 896.212796] env[69847]: INFO networking_nsxv3.common.synchronization [req-95531152-2122-4b56-ac09-3561bc48d3ca req-aa28376f-c877-499b-a0fc-48aca17701bf service nova] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 896.213043] env[69847]: INFO networking_nsxv3.common.synchronization [req-95531152-2122-4b56-ac09-3561bc48d3ca req-aa28376f-c877-499b-a0fc-48aca17701bf service nova] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 896.213702] env[69847]: INFO networking_nsxv3.common.synchronization [req-95531152-2122-4b56-ac09-3561bc48d3ca req-aa28376f-c877-499b-a0fc-48aca17701bf service nova] Enqueued Resource ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with Priority: HIGHEST for action port [ 896.213955] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 896.214092] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 896.214186] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with Priority: HIGHEST for action port [ 896.214767] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.214891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.214958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.215169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.215252] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.216066] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.216149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.216341] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.216480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.216519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.216871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.216871] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff6548c-7043-496b-8a2b-7a622dd2ef6a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.718485] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.718485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.718707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with status ACTIVE [ 896.718834] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.718944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.719010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.719262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.719357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.719550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.719664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.719725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.719887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.719984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.720180] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.720358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.720426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.720576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.720652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.720737] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a is going to be updated. [ 896.741635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.741831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.741915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.742109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.742251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.742451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.177112] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 897.177396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.177396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.178759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.178759] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.178759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.178759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.178759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.178759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.178759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.178759] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.229129] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed75997f-b90e-4293-87d9-210d47742e8b req-0ecc99e2-2e52-4f77-91f2-d5e1fa38bba5 tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 897.229129] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 897.229480] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.230062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.230251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.230562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.230832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.231071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.231237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.231506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.231718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.232802] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.545775] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.546042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.546181] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.546485] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.546777] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.546990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.547156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.547404] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.547641] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.547937] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.548094] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.548235] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.548370] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.548510] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.548645] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.548819] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.565771] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.565771] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 897.565771] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.566191] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.566310] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-af01b80f-17e5-4645-85a7-7d19602935eb taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.566485] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.566606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.566943] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.567104] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af01b80f-17e5-4645-85a7-7d19602935eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.680928] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.738752] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.069944] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.070376] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.070376] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.070641] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.070866] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.071106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port af01b80f-17e5-4645-85a7-7d19602935eb not found, creating... [ 898.071427] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.071656] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.071754] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.072353] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.072353] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.072640] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.072836] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.072968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.073232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.073356] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.073524] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: af01b80f-17e5-4645-85a7-7d19602935eb is going to be created. [ 898.091985] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.092215] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.092351] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.093458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.093458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.093458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.183732] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2390abe6-0ba8-4ab0-8c91-187bd39ef80c: rpc.has_security_group_logging(os_id): False [ 898.213738] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.213926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.213975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.214173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.214320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.214495] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.214607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.214652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.214822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.214859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.214929] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be updated. [ 898.226769] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 898.227045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.227212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.227410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.227625] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.227718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.227761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.227876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.227948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.228056] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.242162] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.279435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.279578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.279646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.279848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.279991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.291945] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: IN_PROGRESS for 2s [ 898.730555] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.744149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.744286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.744351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.744741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.744741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.744741] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 898.769685] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.769809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.769880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.770224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.770268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.778127] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 898.849076] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed75997f-b90e-4293-87d9-210d47742e8b req-daef872c-6de8-4d57-b44c-922ce381ed4e service nova] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_rules [ 898.849291] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed75997f-b90e-4293-87d9-210d47742e8b req-daef872c-6de8-4d57-b44c-922ce381ed4e service nova] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 898.849464] env[69847]: INFO networking_nsxv3.common.synchronization [req-ed75997f-b90e-4293-87d9-210d47742e8b req-daef872c-6de8-4d57-b44c-922ce381ed4e service nova] Enqueued Resource ID: af01b80f-17e5-4645-85a7-7d19602935eb with Priority: HIGHEST for action port [ 898.849968] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_rules [ 898.850158] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 898.850270] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af01b80f-17e5-4645-85a7-7d19602935eb with Priority: HIGHEST for action port [ 898.850564] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.850694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.850762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.850961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.851054] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.851868] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.851962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.852171] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-af01b80f-17e5-4645-85a7-7d19602935eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.852270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.852375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.852540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.852614] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af01b80f-17e5-4645-85a7-7d19602935eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.237407] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.354242] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.354401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.354578] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af01b80f-17e5-4645-85a7-7d19602935eb with status ACTIVE [ 899.354747] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.354851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.354913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.355136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.355222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.355389] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.355484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.355555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.355685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.355759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.355937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.356039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.356095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.356232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.356305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.356388] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af01b80f-17e5-4645-85a7-7d19602935eb is going to be updated. [ 899.376906] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.376906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.376906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.376906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.376906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.376906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af01b80f-17e5-4645-85a7-7d19602935eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.740226] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.741030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.741030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.741030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.741030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.741030] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 899.766470] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.766470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.766649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.766729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.766873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.776353] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 900.306879] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 900.306879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.787581] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 900.787827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.788179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.788272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.788500] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.788626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.788686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.788889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.788983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.789130] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.291404] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.785166] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 901.785435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.785656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.785762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.785960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.786093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.786160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.786320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.786401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.786491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.786582] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.793769] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.291823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.291823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.291823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.292742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.293117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.293455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.293706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.293919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.294089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.294314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.295245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.295442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.295595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.295725] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.297191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.297306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.297373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.297582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.297694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.297811] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 902.326207] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.326207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.326367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.326486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.326714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.339026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 902.801100] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88aae7-5837-4451-89b6-8972ab00f699: rpc.has_security_group_logging(os_id): False [ 902.819940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.820315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.820406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.821793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.839068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.839345] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.839473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.839547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.839766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.839847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.840142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.840248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.840473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.840685] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.840780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.841225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841326] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 902.900534] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.900686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.900777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.900993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.901159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.920028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 903.566860] env[69847]: INFO networking_nsxv3.common.synchronization [None req-0cbca817-2d3d-466f-a9cb-ad6d641746bf None None] Enqueued Resource ID: 8d391e56-48a5-4b2a-8618-d27b452e242f with Priority: HIGHEST for action port [ 903.567398] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d391e56-48a5-4b2a-8618-d27b452e242f with Priority: HIGHEST for action port [ 903.567705] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d391e56-48a5-4b2a-8618-d27b452e242f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.567870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d391e56-48a5-4b2a-8618-d27b452e242f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.567917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d391e56-48a5-4b2a-8618-d27b452e242f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.568182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d391e56-48a5-4b2a-8618-d27b452e242f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.568243] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d391e56-48a5-4b2a-8618-d27b452e242f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.070216] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d391e56-48a5-4b2a-8618-d27b452e242f [ 904.070520] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.070658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.070741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.070982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.073108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.073108] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d391e56-48a5-4b2a-8618-d27b452e242f already deleted. [ 904.073108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d391e56-48a5-4b2a-8618-d27b452e242f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.346904] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 904.347660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.347660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.347660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.347819] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.347884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.347978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.348196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.348307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.348426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.348581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.475364] env[69847]: INFO networking_nsxv3.common.synchronization [req-8a07d3ff-cfea-44a4-be9e-aa7dc43db54e req-48069120-ec0a-437b-91c2-5a5b4e1692b7 tempest-SecurityGroupRulesNegativeTestJSON-2106875015 tempest-SecurityGroupRulesNegativeTestJSON-2106875015-project-member] Enqueued Resource ID: e99d66c1-beaf-4601-956d-50aaef1dc1ab with Priority: HIGHEST for action security_group_rules [ 904.475832] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99d66c1-beaf-4601-956d-50aaef1dc1ab with Priority: HIGHEST for action security_group_rules [ 904.476155] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.476297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.476367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.476614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.476718] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99d66c1-beaf-4601-956d-50aaef1dc1ab',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.818555] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a097bb6-2e4b-4cb7-81b0-795e43cc7057 req-b6c88ebc-c900-403d-979c-63ad0769e98d tempest-SecurityGroupRulesNegativeTestJSON-2106875015 tempest-SecurityGroupRulesNegativeTestJSON-2106875015-project-member] Enqueued Resource ID: e99d66c1-beaf-4601-956d-50aaef1dc1ab with Priority: HIGHEST for action security_group_rules [ 904.819710] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99d66c1-beaf-4601-956d-50aaef1dc1ab with Priority: HIGHEST for action security_group_rules [ 904.820189] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.820284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.850761] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.850928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.851075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.852013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852231] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.852354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.852428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.852628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.852720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.852810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.852968] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.853079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.853133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.853282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.853420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.853512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.853570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.853707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.853784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.853863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.853954] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.936992] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 904.940316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.007225] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.007225] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99d66c1-beaf-4601-956d-50aaef1dc1ab already deleted. [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.007225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.007225] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99d66c1-beaf-4601-956d-50aaef1dc1ab',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.214151] env[69847]: INFO networking_nsxv3.common.synchronization [req-9d0c2495-306a-49e2-b487-2c547e6a3b93 req-d4eb0b6b-d5b6-4e22-897c-f31fdb7d4239 tempest-ListImageFiltersTestJSON-1710148665 tempest-ListImageFiltersTestJSON-1710148665-project-member] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 905.216988] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGHEST for action security_group_members [ 905.217352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.217568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.217568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.217753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.217904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.218017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.218099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.218216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.218298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.218389] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.231245] env[69847]: INFO networking_nsxv3.common.synchronization [req-d39e05f7-3fd4-4495-bc77-867a2199fb4c req-f0d850c4-c705-4368-bb38-fab84977fd6e tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 905.231753] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 905.232064] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.232191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.232256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.232546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.232668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.232775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.232834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.232990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.234817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.234930] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.357619] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ebba71e-a742-472f-8890-25c0bf66f3fa: rpc.has_security_group_logging(os_id): False [ 905.374753] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.374893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.374963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.375192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.375282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.375496] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.375597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.375658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.375843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.375925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.376127] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.376223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.376283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.376448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.376534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.376714] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.376824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.376885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.378011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.379765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.379898] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 905.435451] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.435648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.435695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.435883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.436096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.450110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 905.531027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.531027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.531027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.531027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.531027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.531027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99d66c1-beaf-4601-956d-50aaef1dc1ab already deleted. [ 905.531027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99d66c1-beaf-4601-956d-50aaef1dc1ab" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.638907] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-520 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.638907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-520" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.638907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-520" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.639365] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-520" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.639694] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.639864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.640017] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.640407] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.640450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.640699] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.640822] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.640945] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.641071] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.641189] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 905.641338] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.641417] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.660318] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.660318] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 905.660318] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.660318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-520" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.660318] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ffaf4d51-fb58-42b9-a361-69a15b0c177a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.660318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.660318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.660318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.660972] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffaf4d51-fb58-42b9-a361-69a15b0c177a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.724349] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.727084] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.727084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.727084] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be updated. [ 905.738238] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.738353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.738353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.738605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.738605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.739413] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.739413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.739413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.739413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.739413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.739413] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd already deleted. [ 905.739413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.749391] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.749391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.749391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.749391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.749391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.757528] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: IN_PROGRESS for 2s [ 905.884932] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4e582bb4-ff41-40db-ae99-9ab9e5866f1d None None] Enqueued Resource ID: 7982a593-3bf2-41a9-919e-0222d20683e3 with Priority: HIGHEST for action port [ 905.885220] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7982a593-3bf2-41a9-919e-0222d20683e3 with Priority: HIGHEST for action port [ 905.885819] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-7982a593-3bf2-41a9-919e-0222d20683e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.885916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7982a593-3bf2-41a9-919e-0222d20683e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.885954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7982a593-3bf2-41a9-919e-0222d20683e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.886518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7982a593-3bf2-41a9-919e-0222d20683e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.886584] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7982a593-3bf2-41a9-919e-0222d20683e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.162398] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.162698] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.162824] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.163115] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.163260] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.163431] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ffaf4d51-fb58-42b9-a361-69a15b0c177a not found, creating... [ 906.163714] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.163868] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.163981] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.164216] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.164349] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.164664] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.164905] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.165512] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.165512] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.165512] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.165512] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a is going to be created. [ 906.184792] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.185026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.185153] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.185707] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.185707] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.185864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.301128] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 906.301383] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 906.303516] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 906.303516] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 906.303516] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.303516] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.303516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.303516] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.304339] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.304418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.304456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.308024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.308024] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.308024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.308024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.308024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.308024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.308024] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_rules [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [req-3eb3594d-1cb7-4496-ab01-5e15d801a2db req-34c9ac02-ff83-4865-aef5-8b17aac8cd02 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with Priority: HIGHEST for action port [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_rules [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with Priority: HIGHEST for action port [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 906.350339] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 906.350859] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.350859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.350859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.350985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.350985] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.355237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.355554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.355554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.355681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.355769] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.356546] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.356634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.356701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.357027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.357105] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff6548c-7043-496b-8a2b-7a622dd2ef6a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.357842] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.357910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.358093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.358174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.389276] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7982a593-3bf2-41a9-919e-0222d20683e3 [ 906.389276] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.389276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.389276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.389589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.389589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.389700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7982a593-3bf2-41a9-919e-0222d20683e3 already deleted. [ 906.389700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7982a593-3bf2-41a9-919e-0222d20683e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.810630] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.812282] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.862008] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.862008] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.862008] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with status ACTIVE [ 906.862008] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.862008] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.862008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.862688] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.862688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.862688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.862688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.865036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.865036] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a is going to be updated. [ 906.886175] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.886175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.886175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.886175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.886175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.886175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.969044] env[69847]: INFO networking_nsxv3.common.synchronization [req-d39e05f7-3fd4-4495-bc77-867a2199fb4c req-223b9c6a-598c-4999-8729-0f7322a88798 service nova] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_rules [ 906.972061] env[69847]: INFO networking_nsxv3.common.synchronization [req-d39e05f7-3fd4-4495-bc77-867a2199fb4c req-223b9c6a-598c-4999-8729-0f7322a88798 service nova] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 906.972276] env[69847]: INFO networking_nsxv3.common.synchronization [req-d39e05f7-3fd4-4495-bc77-867a2199fb4c req-223b9c6a-598c-4999-8729-0f7322a88798 service nova] Enqueued Resource ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a with Priority: HIGHEST for action port [ 906.974488] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_rules [ 906.974488] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 906.974488] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a with Priority: HIGHEST for action port [ 906.974488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.974488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.974488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.974488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.974488] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.975940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.975940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.975940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.975940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.975940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.975940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.975940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.976604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.976604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.976604] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.977187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffaf4d51-fb58-42b9-a361-69a15b0c177a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.977296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.977335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.977748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.977748] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffaf4d51-fb58-42b9-a361-69a15b0c177a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.314638] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.317229] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.462023] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 907.462263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.480685] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.480685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.480685] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.481252] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffaf4d51-fb58-42b9-a361-69a15b0c177a with status ACTIVE [ 907.481435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.481567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.481634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.481817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.481903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.482088] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.482184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.482237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.482388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.482593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.485174] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.485288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.485340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.485539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.485607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.485688] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a is going to be updated. [ 907.507779] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.507972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.507972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.511323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.511323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.511323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.766787] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 in Status: SUCCESS [ 907.767942] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 deletion is rescheduled due to dependency. [ 907.768068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.820028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.820028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 is going to be created. [ 907.820028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.820028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.820028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 907.843217] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.843360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.843605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.843723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.844535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.846764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.847029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.847271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.847500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.847767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.858242] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 907.859132] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: UNINITIALIZED for 2s [ 907.988907] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.490373] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.490670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.490739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.491009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.491220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.491373] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be created. [ 908.515896] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.515896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.515896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.516733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.517161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.526272] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: UNINITIALIZED for 2s [ 909.868865] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 909.869223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.870115] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: SUCCESS [ 909.870350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.870746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.871037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.871226] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.871342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.871408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.871577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.871659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.871754] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.873340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.873666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.873933] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.874106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.874217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.874414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.874544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.875295] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.264791] env[69847]: INFO networking_nsxv3.common.synchronization [req-b325d376-c9b9-4160-b3f8-1ef28c4bc7d2 req-9b6ea79d-d1e0-4797-baba-29574917d5cb tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 910.265374] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 910.265707] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.265864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.265943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.269202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.269658] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.271167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.271251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.271440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.271532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.271634] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.377366] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.378577] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.536550] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 910.536550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.536550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.536550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.538398] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.538398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.538398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.538398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.538398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.538398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.538398] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.774457] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.774619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.774692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.774947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.775057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.775253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.775354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.775413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.775568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.775647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.775728] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be deleted. [ 910.809194] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.809362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.809495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.809715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.809814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.809917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.881379] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.882341] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.040208] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.040380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.040444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.040699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.040933] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.041021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.041073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.041246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.041348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.041435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.041591] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.041740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.041783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.041952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.042119] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.042227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.042298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.042454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.042562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.042659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.042750] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.094341] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.094907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.094907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.094907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.095182] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.095338] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.095726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.095726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.095831] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.096043] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.096166] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.096279] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.096390] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.096501] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.096611] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.096743] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.242975] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.243158] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.146 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 911.243292] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.243463] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.243770] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-be00b3b7-b558-48b2-9b3a-d08229509b31 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.243933] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.244059] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.244392] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.244535] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be00b3b7-b558-48b2-9b3a-d08229509b31',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.384832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.385007] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.385090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.385308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.385398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.385497] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 is going to be updated. [ 911.386776] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.386888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.386955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.387138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.387219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.387306] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 911.420394] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.420526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.420574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.420792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.420937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.422676] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.422783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.422883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.423067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.423141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.431975] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 911.432579] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: IN_PROGRESS for 2s [ 911.545352] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd: rpc.has_security_group_logging(os_id): False [ 911.564901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.564901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.564901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.564901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.565736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.565736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.565736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.565736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.565736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.565736] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be created. [ 911.621121] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.621121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.621121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.621121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.621121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.632198] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 911.750022] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.750022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port be00b3b7-b558-48b2-9b3a-d08229509b31 not found, creating... [ 911.750022] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.750022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.750681] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.750681] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.750681] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.750681] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.750681] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.750681] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: be00b3b7-b558-48b2-9b3a-d08229509b31 is going to be created. [ 911.777613] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.778157] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.778404] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.778781] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.779141] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.779473] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.832663] env[69847]: INFO networking_nsxv3.common.synchronization [None req-2cb8ed72-e502-4090-bdbb-9104b1dbb037 None None] Enqueued Resource ID: 73b6a024-0d7e-43f1-b1fb-76420ab4b504 with Priority: HIGHEST for action port [ 911.832663] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73b6a024-0d7e-43f1-b1fb-76420ab4b504 with Priority: HIGHEST for action port [ 911.832663] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-73b6a024-0d7e-43f1-b1fb-76420ab4b504 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.832663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73b6a024-0d7e-43f1-b1fb-76420ab4b504" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.832663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73b6a024-0d7e-43f1-b1fb-76420ab4b504" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.835280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73b6a024-0d7e-43f1-b1fb-76420ab4b504" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.835482] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73b6a024-0d7e-43f1-b1fb-76420ab4b504',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.343182] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73b6a024-0d7e-43f1-b1fb-76420ab4b504 [ 912.344730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.344860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.344938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.345184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.345281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.345394] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73b6a024-0d7e-43f1-b1fb-76420ab4b504 already deleted. [ 912.345471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73b6a024-0d7e-43f1-b1fb-76420ab4b504" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.511073] env[69847]: INFO networking_nsxv3.common.synchronization [req-b325d376-c9b9-4160-b3f8-1ef28c4bc7d2 req-2c95558c-8439-468b-bbeb-d678252367b9 service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 912.511073] env[69847]: INFO networking_nsxv3.common.synchronization [req-b325d376-c9b9-4160-b3f8-1ef28c4bc7d2 req-2c95558c-8439-468b-bbeb-d678252367b9 service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 912.511073] env[69847]: INFO networking_nsxv3.common.synchronization [req-b325d376-c9b9-4160-b3f8-1ef28c4bc7d2 req-2c95558c-8439-468b-bbeb-d678252367b9 service nova] Enqueued Resource ID: be00b3b7-b558-48b2-9b3a-d08229509b31 with Priority: HIGHEST for action port [ 912.511452] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 912.511452] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 912.511544] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be00b3b7-b558-48b2-9b3a-d08229509b31 with Priority: HIGHEST for action port [ 912.514406] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.515301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.515301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.515301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.515301] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.515973] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.516096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.516169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.516345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.516504] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.516596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.516653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.516790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.516867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.516954] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.520963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-be00b3b7-b558-48b2-9b3a-d08229509b31 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.521117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.521180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.521484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.521484] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be00b3b7-b558-48b2-9b3a-d08229509b31',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.873698] env[69847]: INFO networking_nsxv3.common.synchronization [req-76d85b48-dc67-426d-acb7-ab66e9f70659 req-b6d6ee4b-3556-424a-9897-af36b6e3ec99 tempest-InstanceActionsTestJSON-679254814 tempest-InstanceActionsTestJSON-679254814-project-member] Enqueued Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_members [ 912.874281] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_members [ 912.874604] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.874726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.874801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.875343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.875531] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.875681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.875735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.875881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.875962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.876278] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.948208] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9a4e5b10-2e2a-4585-910f-ca6f489523fe tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 912.948715] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 912.949026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.949338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.949419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.949654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.949738] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.023168] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.028235] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.028235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.028235] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be00b3b7-b558-48b2-9b3a-d08229509b31 with status ACTIVE [ 913.028235] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.028235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.028235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.032330] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.032330] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.032330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.032330] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be00b3b7-b558-48b2-9b3a-d08229509b31 is going to be updated. [ 913.057056] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.057268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.057268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.057516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.057651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.057840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be00b3b7-b558-48b2-9b3a-d08229509b31" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.077847] env[69847]: INFO networking_nsxv3.common.synchronization [None req-de3ed0d4-59dc-4b77-a5c1-bf9d63d3f960 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 913.078794] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 913.079422] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.079801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.360763] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.360763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-17" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.360763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-17" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.360763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-17" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.367347] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.367347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.367347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.367347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.367347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.367347] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.367347] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.367347] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.367347] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.367347] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.367347] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.367347] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.381326] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.381707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.381889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.382216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.382551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.383215] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.383455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.383705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.383990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.384290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.384562] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 already deleted. [ 913.384786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.385968] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.386286] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.386567] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.386866] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-17" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.387346] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-c82a795c-e1ba-43c9-9544-439023590204 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.388986] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.388986] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.388986] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.388986] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c82a795c-e1ba-43c9-9544-439023590204',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.447031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: SUCCESS [ 913.447031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.447031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 913.447031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.447031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.447031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.447031] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.447031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.447031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.447531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.447531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.447607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.448773] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.448773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.449028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.449028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.449127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.449164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.449361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.449361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.449464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.449509] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.472255] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.472394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.472465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.472703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.472795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.472895] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 already deleted. [ 913.472976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.473389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.473566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.473675] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.540869] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.581169] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 913.584272] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_members [ 913.584272] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 913.584272] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 913.584272] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_members [ 913.584272] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 913.584975] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.585435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.589281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.589281] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.589281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c708bb4-e258-4463-ae37-75ba070cebc2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.589281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.593020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.593020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.593020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.593020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.593020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.593020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.598571] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.651561] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 913.651561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_rules [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_members [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_rules [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 913.734365] env[69847]: INFO networking_nsxv3.common.synchronization [req-897229d8-8ec1-44c8-9a3e-b6b5c3e3278a req-14016aca-e0fc-4fd6-83bb-9aea1d108a44 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with Priority: HIGHEST for action port [ 913.735440] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_rules [ 913.735544] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_rules [ 913.735593] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 913.735685] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with Priority: HIGHEST for action port [ 913.735773] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_rules [ 913.735877] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_members [ 913.736027] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 913.736269] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c708bb4-e258-4463-ae37-75ba070cebc2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.736450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.736512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.736751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.736852] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.738458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.738458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.738458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.738742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.738742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.738856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.738915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.739234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.739319] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ff6548c-7043-496b-8a2b-7a622dd2ef6a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.743041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.743041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.743041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c708bb4-e258-4463-ae37-75ba070cebc2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.743041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.743041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.743041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.891337] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.893044] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.894429] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.896102] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.896467] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.896659] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port c82a795c-e1ba-43c9-9544-439023590204 not found, creating... [ 913.897305] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.897565] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.898217] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.898622] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.899188] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.900530] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.900726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.900872] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.901141] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.901291] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.901452] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: c82a795c-e1ba-43c9-9544-439023590204 is going to be created. [ 913.921841] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.922161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.922314] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.922749] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.923036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.923285] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.951821] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.953875] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.954088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.992661] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.992820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.992902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.993139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.993257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.993521] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 already deleted. [ 913.993521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.042620] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.042816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.042883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.043121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.043227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.043328] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be created. [ 914.081679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.082477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.082477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.084015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.084015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.094371] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: UNINITIALIZED for 2s [ 914.100838] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.100838] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.103108] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.242258] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c708bb4-e258-4463-ae37-75ba070cebc2 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.242406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.242686] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ff6548c-7043-496b-8a2b-7a622dd2ef6a with status ACTIVE [ 914.242983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.242983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.243161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.243276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.243407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.243680] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.243831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.243896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.244157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.244244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.244449] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.244578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.244641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.244787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.244906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.244970] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ff6548c-7043-496b-8a2b-7a622dd2ef6a is going to be updated. [ 914.272943] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.273111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.273286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.273386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.273558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.273751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ff6548c-7043-496b-8a2b-7a622dd2ef6a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.321027] env[69847]: INFO networking_nsxv3.common.synchronization [None req-38c6ddee-cddb-4e57-b238-4d30004920cd None None] Enqueued Resource ID: 689bf431-ce7c-467b-b56a-2d7c992eec7a with Priority: HIGHEST for action port [ 914.321027] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689bf431-ce7c-467b-b56a-2d7c992eec7a with Priority: HIGHEST for action port [ 914.321027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-689bf431-ce7c-467b-b56a-2d7c992eec7a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.321817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-689bf431-ce7c-467b-b56a-2d7c992eec7a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.322080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-689bf431-ce7c-467b-b56a-2d7c992eec7a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.324245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-689bf431-ce7c-467b-b56a-2d7c992eec7a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.324245] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689bf431-ce7c-467b-b56a-2d7c992eec7a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.455103] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a81381ed-5136-4eb7-9b59-4431bf5e38a1: rpc.has_security_group_logging(os_id): False [ 914.476216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.476361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.476790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.476790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.476790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.477474] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.477474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.477474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.477474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.477474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.477474] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 is going to be created. [ 914.535585] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.535734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.535954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.536128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.536360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.547425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: IN_PROGRESS for 2s [ 914.602148] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.603639] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.604026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.604146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.604210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.604732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.604732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.604732] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 is going to be updated. [ 914.653189] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.653189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.653189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.653189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.653189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.661623] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: IN_PROGRESS for 2s [ 914.695934] env[69847]: INFO networking_nsxv3.common.synchronization [req-76d85b48-dc67-426d-acb7-ab66e9f70659 req-19ced782-df2f-46cd-ab1b-061a9bf28518 service nova] Enqueued Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_rules [ 914.696520] env[69847]: INFO networking_nsxv3.common.synchronization [req-76d85b48-dc67-426d-acb7-ab66e9f70659 req-19ced782-df2f-46cd-ab1b-061a9bf28518 service nova] Enqueued Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_members [ 914.697082] env[69847]: INFO networking_nsxv3.common.synchronization [req-76d85b48-dc67-426d-acb7-ab66e9f70659 req-19ced782-df2f-46cd-ab1b-061a9bf28518 service nova] Enqueued Resource ID: c82a795c-e1ba-43c9-9544-439023590204 with Priority: HIGHEST for action port [ 914.697753] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_rules [ 914.701021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_members [ 914.701021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c82a795c-e1ba-43c9-9544-439023590204 with Priority: HIGHEST for action port [ 914.701021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.701021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.701021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.701021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.701021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.701021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.703240] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c82a795c-e1ba-43c9-9544-439023590204 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.703641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.703846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.704177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.704343] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c82a795c-e1ba-43c9-9544-439023590204',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.825460] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 689bf431-ce7c-467b-b56a-2d7c992eec7a [ 914.825698] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.825875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.825967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.826249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.826383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.826490] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:689bf431-ce7c-467b-b56a-2d7c992eec7a already deleted. [ 914.826576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-689bf431-ce7c-467b-b56a-2d7c992eec7a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.105067] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.105236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.105283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.105469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.105552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.105672] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 915.107362] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.107471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.107471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.107630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.107783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.107846] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 is going to be created. [ 915.141237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.141449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.141449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.141621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.141754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.153029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.153029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.153029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.153029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.153029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.153029] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 in Status: UNINITIALIZED for 2s [ 915.162652] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 915.210294] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.210294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.210294] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c82a795c-e1ba-43c9-9544-439023590204 with status ACTIVE [ 915.210294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.210294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.210294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.210953] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.210953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.210953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.210953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.210953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.210953] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c82a795c-e1ba-43c9-9544-439023590204 is going to be updated. [ 915.250696] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.250696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.250696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.250696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.250696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.250696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c82a795c-e1ba-43c9-9544-439023590204" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.493018] env[69847]: INFO networking_nsxv3.common.synchronization [req-5cfed3f4-9c8c-4483-bb14-de5ce9ac629d req-f2be1469-ddb5-4a15-9425-b2b0a85e766d tempest-ImagesOneServerTestJSON-1247170315 tempest-ImagesOneServerTestJSON-1247170315-project-member] Enqueued Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_members [ 915.493018] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_members [ 915.493018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.493018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.493018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.493018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.493495] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.493495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.493495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.493662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.493794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.494083] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.717662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.900466] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-133 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.901169] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-133" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.902271] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-133" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.902745] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-133" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.904119] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.904441] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.904672] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.905147] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.905409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.905726] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.905961] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.906179] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.906380] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.906594] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.907014] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.908022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.928028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.928028] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.928028] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.928028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-133" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.928028] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.928028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.928028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.928028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.928028] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a129472b-4a7a-41f5-bd7c-8bd534fee3d4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.999026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.999026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.999026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.999227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.999227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.999370] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.999481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.999526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.999677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.999755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.999855] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ca119d-bde2-4386-8868-06f3fb18260c already deleted. [ 915.999918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.104077] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 916.104343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.104585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.104761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.104976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.105110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.105177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.105335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.105417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.105501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.105589] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.220601] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.220601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.220601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.220601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.220782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.220782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 is going to be created. [ 916.246601] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.246764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.246764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.247075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.247567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.261111] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 in Status: UNINITIALIZED for 2s [ 916.418797] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cb9b37-47bd-417f-87b7-0bfc7d42aab3 req-9e4bd67f-71ab-47d9-b048-452ae62c12dc tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_members [ 916.418896] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cb9b37-47bd-417f-87b7-0bfc7d42aab3 req-9e4bd67f-71ab-47d9-b048-452ae62c12dc tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 916.419134] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cb9b37-47bd-417f-87b7-0bfc7d42aab3 req-9e4bd67f-71ab-47d9-b048-452ae62c12dc tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 916.420315] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 with Priority: HIGHEST for action security_group_members [ 916.420315] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 with Priority: HIGHEST for action security_group_members [ 916.420315] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 916.420315] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c708bb4-e258-4463-ae37-75ba070cebc2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.420315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.420609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a81381ed-5136-4eb7-9b59-4431bf5e38a1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.420609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.420742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.420845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.432108] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.432108] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.432427] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.433115] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.433343] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.433555] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port a129472b-4a7a-41f5-bd7c-8bd534fee3d4 not found, creating... [ 916.434042] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.434270] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.434431] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.434726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.435106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.435587] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.435823] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.436039] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.436272] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.436474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.438058] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: a129472b-4a7a-41f5-bd7c-8bd534fee3d4 is going to be created. [ 916.472149] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.472149] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.472149] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.472149] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.472149] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.472149] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.564739] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: SUCCESS [ 916.565090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.565595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.565595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.565595] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.609250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.609250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.609250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.609250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.609250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.610424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.610424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.612058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.612058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.612058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.612696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.612696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.612696] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.671778] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 in Status: SUCCESS [ 916.672041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.672233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.672482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.672712] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.672847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.672919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.673118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.673194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.673294] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.094260] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.094419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.094488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.094702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.094793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.094913] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 is going to be deleted. [ 917.114738] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b495386a-9f65-4bd6-a72b-2cc4c5b333fe: rpc.has_security_group_logging(os_id): False [ 917.141887] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.142188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.142431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.142613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.142838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.143020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.143267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.143267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.143458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.143586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.143729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.143729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.143802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.144014] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.144080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.144129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.144292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.144406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.144528] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be created. [ 917.146291] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.146414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.146458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.146620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.146702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.146805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.165519] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 in Status: SUCCESS [ 917.165858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.166163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.167839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.167839] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.167839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.167839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.167839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.167839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.167839] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.173729] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.176018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.176018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.176018] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.176018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.177050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.177261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.177632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.177828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.178240] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.178573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.181018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.181018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.181018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.181018] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 is going to be deleted. [ 917.218569] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.221407] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.221407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.221407] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a81381ed-5136-4eb7-9b59-4431bf5e38a1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.251420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.251420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.251420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.251420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.251420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.284150] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 917.651841] env[69847]: INFO networking_nsxv3.common.synchronization [req-5cfed3f4-9c8c-4483-bb14-de5ce9ac629d req-06ac9616-c6cb-4047-919d-54f9f1a224cc service nova] Enqueued Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_rules [ 917.652171] env[69847]: INFO networking_nsxv3.common.synchronization [req-5cfed3f4-9c8c-4483-bb14-de5ce9ac629d req-06ac9616-c6cb-4047-919d-54f9f1a224cc service nova] Enqueued Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_members [ 917.652227] env[69847]: INFO networking_nsxv3.common.synchronization [req-5cfed3f4-9c8c-4483-bb14-de5ce9ac629d req-06ac9616-c6cb-4047-919d-54f9f1a224cc service nova] Enqueued Resource ID: a129472b-4a7a-41f5-bd7c-8bd534fee3d4 with Priority: HIGHEST for action port [ 917.652791] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_rules [ 917.652928] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_members [ 917.653035] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a129472b-4a7a-41f5-bd7c-8bd534fee3d4 with Priority: HIGHEST for action port [ 917.653316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.653436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.653503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.657286] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.657286] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.657286] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.657286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.657749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.661244] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.661244] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.661244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.661244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.661244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.661244] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a129472b-4a7a-41f5-bd7c-8bd534fee3d4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.670709] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.671902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.671902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.671902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.671902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.671902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.671902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.671902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.672258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.672258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.672258] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 is going to be deleted. [ 917.682185] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.698217] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.698217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.698421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.698461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.698544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.698658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.699053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.699223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.699382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.699482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.699546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.699701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.699783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.699873] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.708293] env[69847]: INFO networking_nsxv3.common.synchronization [req-2ead198b-39cc-47d7-8d35-9eef25216c99 req-68d201a8-5695-4a47-a566-98caae981c95 tempest-VolumesAssistedSnapshotsTest-805081964 tempest-VolumesAssistedSnapshotsTest-805081964-project-member] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_members [ 917.708773] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGHEST for action security_group_members [ 917.709100] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.709207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.709279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.709460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.709613] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.709712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.709769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.709912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.709992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.710204] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.725026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.725155] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.725155] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.725360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.725449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.725743] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.725851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.725914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.726081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.726161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.726248] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a81381ed-5136-4eb7-9b59-4431bf5e38a1 already deleted. [ 917.726326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a81381ed-5136-4eb7-9b59-4431bf5e38a1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.139294] env[69847]: INFO networking_nsxv3.common.synchronization [req-e48426aa-645d-4aaa-b3f6-bcb375a1fac5 req-b56e31b3-1286-4297-b8b0-34e29318fdae tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 918.139897] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 918.140558] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.140558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.140558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.140754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.140865] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.141116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.141116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.141288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.141398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.141513] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.164928] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.164928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.164928] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.164928] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a129472b-4a7a-41f5-bd7c-8bd534fee3d4 with status ACTIVE [ 918.164928] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.164928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.164928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.164928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.164928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.165358] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.165358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.165358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.165479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.165479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.166253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.166551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.166635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.167521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.167521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.167521] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a129472b-4a7a-41f5-bd7c-8bd534fee3d4 is going to be updated. [ 918.183909] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.188220] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.188383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.188442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.188605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.188762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.188930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a129472b-4a7a-41f5-bd7c-8bd534fee3d4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.203664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.203846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.203846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.204119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.204119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.204283] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.204395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.204518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.204614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.204674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.204731] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 already deleted. [ 918.204802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.204901] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.207173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.208629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.208629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.208629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.208629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.208629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.208629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.208960] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.215220] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.215364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.215429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.215770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.215770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.215966] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.216075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.216075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.216240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.216290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.216385] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c is going to be updated. [ 918.272382] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 in Status: SUCCESS [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.272382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.272382] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.287971] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.288163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.288307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.288504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.288688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.303721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: IN_PROGRESS for 2s [ 918.589456] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.589654] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.589790] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.590142] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.590417] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.590598] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.590722] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.591039] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.591204] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.591422] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.591538] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.591688] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.591909] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.592079] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.592199] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.592333] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.610761] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.610971] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.611092] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.611292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.611614] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3f81aa67-9f18-4d95-85d9-c3a943765742 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.611786] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.611907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.612739] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.612739] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f81aa67-9f18-4d95-85d9-c3a943765742',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.648166] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.648347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.648402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.648582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.648666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.648853] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.648950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.649021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.649169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.649275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.649366] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e already deleted. [ 918.649451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.674780] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.686854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.686989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.687053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.688038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.688038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.688038] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 918.710111] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c708bb4-e258-4463-ae37-75ba070cebc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.712814] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.712957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.713132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.713487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.713487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.713487] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.713718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.713718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.713818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.713856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.713939] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 already deleted. [ 918.714010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.728542] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.728765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.728765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.728925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.729074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.746664] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 918.773681] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.773833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.773907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.774595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.774595] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.774595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.774595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.774595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.775027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.775027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.775027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.775027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.775027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.775358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.775358] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.775358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.775475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.775599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.775647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.775685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.775777] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.114961] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.115172] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.115302] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.115654] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.115654] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.115880] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3f81aa67-9f18-4d95-85d9-c3a943765742 not found, creating... [ 919.116068] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.116238] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.116358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.116656] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.116763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.117054] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.117182] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.117308] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.117521] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.117660] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.117829] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3f81aa67-9f18-4d95-85d9-c3a943765742 is going to be created. [ 919.137014] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.137244] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.137373] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.137676] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.137916] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.138218] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.177755] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.177924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.177989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.178345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.178755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.178755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ca119d-bde2-4386-8868-06f3fb18260c is going to be created. [ 919.212771] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c708bb4-e258-4463-ae37-75ba070cebc2: rpc.has_security_group_logging(os_id): False [ 919.237975] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.238170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.238244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.238448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.238609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.243362] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.243501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.243543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.243747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.243835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.244074] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.244281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.244281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.244392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.244462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.244558] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 is going to be created. [ 919.253696] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ca119d-bde2-4386-8868-06f3fb18260c in Status: UNINITIALIZED for 2s [ 919.268346] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1c708bb4-e258-4463-ae37-75ba070cebc2], does not exist path=[/infra/domains/default/groups/1c708bb4-e258-4463-ae37-75ba070cebc2]."\n}' [ 919.268551] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c708bb4-e258-4463-ae37-75ba070cebc2 [ 919.268669] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 919.278255] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39d07bbc-a59b-4d28-acdb-434bfad90729: rpc.has_security_group_logging(os_id): False [ 919.301783] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.301930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.302025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.302260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.302352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.302544] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.302653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.302718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.302870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.302948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.303143] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.303237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.303296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.303438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.303510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.303703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.303795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.303856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.303993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.304084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.304167] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 is going to be created. [ 919.317800] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 919.317990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.324657] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.324804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.324867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.325055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.325885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.326148] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.326256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.326319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.326479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.326557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.326749] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.326844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.326899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.327054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.327129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.327213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c708bb4-e258-4463-ae37-75ba070cebc2 is going to be created. [ 919.342850] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1c708bb4-e258-4463-ae37-75ba070cebc2], does not exist path=[/infra/domains/default/groups/1c708bb4-e258-4463-ae37-75ba070cebc2]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c708bb4-e258-4463-ae37-75ba070cebc2 [ 919.342850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c708bb4-e258-4463-ae37-75ba070cebc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.343291] env[69847]: Traceback (most recent call last): [ 919.343388] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 919.343388] env[69847]: return func(*args, **kwargs) [ 919.343388] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 919.343388] env[69847]: res.raise_for_status() [ 919.343388] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 919.343388] env[69847]: raise HTTPError(http_error_msg, response=self) [ 919.343388] env[69847]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c708bb4-e258-4463-ae37-75ba070cebc2 [ 919.343388] env[69847]: During handling of the above exception, another exception occurred: [ 919.343388] env[69847]: Traceback (most recent call last): [ 919.343388] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 919.343388] env[69847]: listener.cb(fileno) [ 919.343388] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 919.343388] env[69847]: result = function(*args, **kwargs) [ 919.343388] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 919.343388] env[69847]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 919.343388] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 919.343388] env[69847]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 919.343388] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 919.343388] env[69847]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 919.343388] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 919.343388] env[69847]: res.raise_for_status() [ 919.343388] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 919.343388] env[69847]: raise HTTPError(http_error_msg, response=self) [ 919.343388] env[69847]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1c708bb4-e258-4463-ae37-75ba070cebc2 [ 919.343388] env[69847]: Removing descriptor: 62 [ 919.379688] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.379688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.380269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.380269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.380269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.390282] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 in Status: IN_PROGRESS for 2s [ 919.858674] env[69847]: INFO networking_nsxv3.common.synchronization [req-e48426aa-645d-4aaa-b3f6-bcb375a1fac5 req-1d674224-dd1c-4292-b98a-fe433f2a9243 service nova] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 919.858674] env[69847]: INFO networking_nsxv3.common.synchronization [req-e48426aa-645d-4aaa-b3f6-bcb375a1fac5 req-1d674224-dd1c-4292-b98a-fe433f2a9243 service nova] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 919.858674] env[69847]: INFO networking_nsxv3.common.synchronization [req-e48426aa-645d-4aaa-b3f6-bcb375a1fac5 req-1d674224-dd1c-4292-b98a-fe433f2a9243 service nova] Enqueued Resource ID: 3f81aa67-9f18-4d95-85d9-c3a943765742 with Priority: HIGHEST for action port [ 919.858674] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 919.858674] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 919.858674] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f81aa67-9f18-4d95-85d9-c3a943765742 with Priority: HIGHEST for action port [ 919.859141] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.859195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.862347] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.862347] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.862347] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.862347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.862347] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.863336] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f81aa67-9f18-4d95-85d9-c3a943765742 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.863336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.863336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.863336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.863336] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f81aa67-9f18-4d95-85d9-c3a943765742',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.313295] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: def2b8bf-1a3c-42a9-ba24-20811016588c in Status: SUCCESS [ 920.313673] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c deletion is rescheduled due to dependency. [ 920.313673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.367909] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.367909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.367909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f81aa67-9f18-4d95-85d9-c3a943765742 with status ACTIVE [ 920.367909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.367909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.367909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.368323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.368323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.368323] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.368323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.368432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.368612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.368612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.368702] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f81aa67-9f18-4d95-85d9-c3a943765742 is going to be updated. [ 920.391093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.391341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.391341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.391496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.391635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.391790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f81aa67-9f18-4d95-85d9-c3a943765742" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.772039] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 920.772276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.772452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.772715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.772902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.773041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.773097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.773247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.773327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.773412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.773739] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.773739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.773739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.773920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.774078] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.774166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.774225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.774364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.774437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.774516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.774603] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.775588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.775760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.775906] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.776012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.776129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.776246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.776302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.776428] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.873773] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.264307] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ca119d-bde2-4386-8868-06f3fb18260c in Status: SUCCESS [ 921.264568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.264789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.265109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.265337] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.265504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.265593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.265795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.265898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.266028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.266150] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.278226] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88aae7-5837-4451-89b6-8972ab00f699: rpc.has_security_group_logging(os_id): False [ 921.279799] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.301293] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.301293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.301293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.301556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.319546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.319903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.320059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.320130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.320343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.320428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.320654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.320757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.320817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.321105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.321188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.321394] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.321492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.321553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.321757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.321856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.322013] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 921.377553] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.377704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.377771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.378106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.378186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.378269] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be created. [ 921.380294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.380498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.380726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.380964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.381438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.404018] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 in Status: SUCCESS [ 921.404267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.405079] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 921.419530] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.420488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.420488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.420488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.420488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.430051] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: UNINITIALIZED for 2s [ 921.771576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.771576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.771576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.771856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.771994] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.772164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.772249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.772472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.772592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.772765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.772950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.773081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.773159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.773637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.773637] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.773713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.773745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.773900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.774016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.774118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.774229] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.782260] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.276603] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8ca119d-bde2-4386-8868-06f3fb18260c: rpc.has_security_group_logging(os_id): False [ 922.289200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.289200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.289200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.289200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.289200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.289200] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 922.315331] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.315475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.315545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.315759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.315848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.316180] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.316180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.316180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.316348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.316410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.316588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.316682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.316749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.316917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.316998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.317208] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.317300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.317360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.317503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.317576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.317682] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8ca119d-bde2-4386-8868-06f3fb18260c is going to be created. [ 922.345272] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.345447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.345505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.345929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.345929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.357915] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 922.398868] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.398868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.399093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.399185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.399362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.417685] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8ca119d-bde2-4386-8868-06f3fb18260c in Status: IN_PROGRESS for 2s [ 923.433336] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 923.433646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.433925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.434658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.434658] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.445097] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 923.445371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.446022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.446022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.446022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.446190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.446190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.446608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.446608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.446608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.446699] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.937592] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.937789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.949427] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.369235] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 924.369327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.369483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.369965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.370169] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.370169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.370253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.373216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.373216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.373216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.373216] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.429795] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8ca119d-bde2-4386-8868-06f3fb18260c in Status: SUCCESS [ 924.429795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.455747] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e: rpc.has_security_group_logging(os_id): False [ 924.470185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.470334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.471027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.471027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.471027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.471027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.471027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.471312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.471312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.471312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.471393] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be created. [ 924.525684] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.525871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.525915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.526101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.526284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.535669] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: IN_PROGRESS for 2s [ 924.859428] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 924.859528] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 924.875270] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.875452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.875553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.875798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.875948] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.876209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.876209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.876400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.876400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.876524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.876689] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.876820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.876920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.877032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.877201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.877320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.877537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.877580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.877678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.877755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.877860] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.384026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c88aae7-5837-4451-89b6-8972ab00f699: rpc.has_security_group_logging(os_id): False [ 925.399856] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.399990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.400082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.400273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.400358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.400538] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.400632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.400683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.402723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.402723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.402723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.402723] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 925.523077] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.523373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.523373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.523508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.523656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.544273] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 926.088149] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.088149] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_members [ 926.088149] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.088298] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_members [ 926.088488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.088605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.088667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.088866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.089028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.089148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.089207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.089353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.089434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.090357] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.090357] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b375832-9bc0-466c-b5af-483563b98390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.090677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.090677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.090794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.090934] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.091037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.091098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.091269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.091349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.091432] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.146794] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_rules [ 926.146974] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_members [ 926.147134] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_rules [ 926.147273] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.147406] env[69847]: INFO networking_nsxv3.common.synchronization [req-f4234461-c7cb-4b01-915d-a2eafb9ce3f2 req-05d4060c-5b0e-4ea3-9bde-44b1c12f88af tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a with Priority: HIGHEST for action port [ 926.147870] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_rules [ 926.148011] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_rules [ 926.148492] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a with Priority: HIGHEST for action port [ 926.148732] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_members [ 926.148922] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.149196] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b375832-9bc0-466c-b5af-483563b98390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.149349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.149349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.149574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.149685] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.151617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.151755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.151847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.152028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.152106] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.153884] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffaf4d51-fb58-42b9-a361-69a15b0c177a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.153884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.153884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.153884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.154043] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffaf4d51-fb58-42b9-a361-69a15b0c177a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.157038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b375832-9bc0-466c-b5af-483563b98390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.157038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.157038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.157038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.551201] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 926.551690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.593188] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.594400] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.656408] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffaf4d51-fb58-42b9-a361-69a15b0c177a with status ACTIVE [ 926.657058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.657058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.657058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.657058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.657242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.657960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.657960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.657960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.657960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.657960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.657960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.657960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.657960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.658270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.658270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.658270] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a is going to be updated. [ 926.659922] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.659922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.659922] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b375832-9bc0-466c-b5af-483563b98390 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.659922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.665222] env[69847]: INFO networking_nsxv3.common.synchronization [req-c6f1fc88-df1a-4109-b498-905a602a2f72 req-100bbaff-0c01-4025-afbd-cc36604dbf4b tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.665477] env[69847]: INFO networking_nsxv3.common.synchronization [req-c6f1fc88-df1a-4109-b498-905a602a2f72 req-100bbaff-0c01-4025-afbd-cc36604dbf4b tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_members [ 926.665625] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.665745] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b375832-9bc0-466c-b5af-483563b98390 with Priority: HIGHEST for action security_group_members [ 926.666290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.666702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.666702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b375832-9bc0-466c-b5af-483563b98390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.666702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.680600] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.680749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.680808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.681046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.681200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.681454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.718024] env[69847]: INFO networking_nsxv3.common.synchronization [req-c6f1fc88-df1a-4109-b498-905a602a2f72 req-100bbaff-0c01-4025-afbd-cc36604dbf4b tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_rules [ 926.718024] env[69847]: INFO networking_nsxv3.common.synchronization [req-c6f1fc88-df1a-4109-b498-905a602a2f72 req-100bbaff-0c01-4025-afbd-cc36604dbf4b tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.718024] env[69847]: INFO networking_nsxv3.common.synchronization [req-c6f1fc88-df1a-4109-b498-905a602a2f72 req-100bbaff-0c01-4025-afbd-cc36604dbf4b tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a with Priority: HIGHEST for action port [ 926.718526] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_rules [ 926.718668] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 926.718764] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a with Priority: HIGHEST for action port [ 926.719053] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.719162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.719414] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.719484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.719664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffaf4d51-fb58-42b9-a361-69a15b0c177a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.719822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.719939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.720130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.720220] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffaf4d51-fb58-42b9-a361-69a15b0c177a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.096963] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.098642] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.224417] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffaf4d51-fb58-42b9-a361-69a15b0c177a with status ACTIVE [ 927.224716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.224859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.224961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.225221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.225320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.225521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.225628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.225707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.225884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.225935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.226162] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.226277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.226341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.226508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.226655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.226719] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffaf4d51-fb58-42b9-a361-69a15b0c177a is going to be updated. [ 927.246330] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.246469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.246539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.246745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.246881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.247165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffaf4d51-fb58-42b9-a361-69a15b0c177a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.560031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 927.560031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.600877] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.602680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.602680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.602680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.602680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.602680] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b375832-9bc0-466c-b5af-483563b98390 is going to be created. [ 927.603671] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.603671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.603987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.604300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.604421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.604550] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be updated. [ 927.632850] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.633026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.633069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.633284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.633444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.636506] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.636506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.636506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.636506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.636506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.644939] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 927.645599] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b375832-9bc0-466c-b5af-483563b98390 in Status: UNINITIALIZED for 2s [ 927.725716] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebe9bafb-1cff-41c0-b9f2-53295936116c req-1e9e42c6-3044-4ce4-b061-c19c62c2b4fe tempest-MigrationsAdminTest-1749055771 tempest-MigrationsAdminTest-1749055771-project-member] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 927.726256] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 927.726590] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.726720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.726788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.727465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.727713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.727867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.727985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.728186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.728289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.728397] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.235472] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.271995] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.271995] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.271995] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.272268] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.272432] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.272592] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.272786] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.273429] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.273429] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.274086] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.274086] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.274086] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.274086] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.274086] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.274262] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.274434] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.293246] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.293434] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.293581] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.293768] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-985" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.294208] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3eadf812-1812-4850-8f93-b3ba4b3c7f25 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.294400] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.294400] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.294719] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.294908] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eadf812-1812-4850-8f93-b3ba4b3c7f25',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.737597] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.805041] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.805041] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3eadf812-1812-4850-8f93-b3ba4b3c7f25 not found, creating... [ 928.805041] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.805041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.805462] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.805462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.805856] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.811407] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.811407] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.811407] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3eadf812-1812-4850-8f93-b3ba4b3c7f25 is going to be created. [ 928.834257] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.834257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.834257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.834257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.834257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.834257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.240224] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.240376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.240445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.240659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.240744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.240849] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be updated. [ 929.266872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.267019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.267095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.267302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.267449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.275090] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 929.656877] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 929.657173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.657343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.657615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.658351] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.658351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.658351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.658351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.658351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.658351] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.659926] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b375832-9bc0-466c-b5af-483563b98390 in Status: SUCCESS [ 929.660228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.660228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.660449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.660713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.660790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.660790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.661030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.661103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.661237] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.713992] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebe9bafb-1cff-41c0-b9f2-53295936116c req-929cf249-002e-4ff6-8d7e-32b2aecbd9d7 service nova] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_rules [ 929.714180] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebe9bafb-1cff-41c0-b9f2-53295936116c req-929cf249-002e-4ff6-8d7e-32b2aecbd9d7 service nova] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 929.714344] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebe9bafb-1cff-41c0-b9f2-53295936116c req-929cf249-002e-4ff6-8d7e-32b2aecbd9d7 service nova] Enqueued Resource ID: 3eadf812-1812-4850-8f93-b3ba4b3c7f25 with Priority: HIGHEST for action port [ 929.714546] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_rules [ 929.717190] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 929.717190] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eadf812-1812-4850-8f93-b3ba4b3c7f25 with Priority: HIGHEST for action port [ 929.718912] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.719093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.719168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.719382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.719462] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.720410] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.720517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.720719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eadf812-1812-4850-8f93-b3ba4b3c7f25 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.720849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.720901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.721087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.721167] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eadf812-1812-4850-8f93-b3ba4b3c7f25',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.163864] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.165334] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.166385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.166540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.166908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.167145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.167501] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.167697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.167840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.169143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.169143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.169143] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b375832-9bc0-466c-b5af-483563b98390 is going to be deleted. [ 930.205528] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.205528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.205528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.205528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.205528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.205766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.205766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.205871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.206075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.207617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.207617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.207617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.207617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.207617] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.226989] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.227216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.230721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eadf812-1812-4850-8f93-b3ba4b3c7f25 with status ACTIVE [ 930.230721] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.230721] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.230721] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.230721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.230721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eadf812-1812-4850-8f93-b3ba4b3c7f25 is going to be updated. [ 930.249811] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.249999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.250087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.250387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.250535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.250814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eadf812-1812-4850-8f93-b3ba4b3c7f25" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.671085] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.710327] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.710327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.710327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.710327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.710327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.710719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.710719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.710719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.710978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.711158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.711282] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b375832-9bc0-466c-b5af-483563b98390 already deleted. [ 930.711363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.711447] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.712281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.712442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.712593] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.712688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.712822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.712977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.713056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.713147] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.174100] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.174521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.174521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.174638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.174729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.174837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be updated. [ 931.212459] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.212625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.212671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.212993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.213151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.215829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.216167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.216167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.216269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.216269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.216451] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.216697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.216697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.216789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.216815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.216886] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b375832-9bc0-466c-b5af-483563b98390 already deleted. [ 931.216964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.218194] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b375832-9bc0-466c-b5af-483563b98390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.227705] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 931.291533] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 931.291768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.291943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.292190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.292386] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.292509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.292614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.293350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.293350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.293350] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.722777] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b375832-9bc0-466c-b5af-483563b98390: rpc.has_security_group_logging(os_id): False [ 931.740291] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.740515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.740751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.741222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.741222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.741544] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.741719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.741850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.742081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.742239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.742377] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b375832-9bc0-466c-b5af-483563b98390 is going to be created. [ 931.757313] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1b375832-9bc0-466c-b5af-483563b98390], does not exist path=[/infra/domains/default/groups/1b375832-9bc0-466c-b5af-483563b98390]."\n}' [ 931.757588] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b375832-9bc0-466c-b5af-483563b98390 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b375832-9bc0-466c-b5af-483563b98390 [ 931.757710] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 931.794990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.795258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.795368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.795701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.796992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.797449] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.797607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.797698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.797969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.798103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.798366] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.798503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.798592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.798850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.798971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.799118] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b375832-9bc0-466c-b5af-483563b98390 is going to be created. [ 931.800654] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.821995] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1b375832-9bc0-466c-b5af-483563b98390], does not exist path=[/infra/domains/default/groups/1b375832-9bc0-466c-b5af-483563b98390]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b375832-9bc0-466c-b5af-483563b98390 [ 931.821995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b375832-9bc0-466c-b5af-483563b98390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.821995] env[69847]: Traceback (most recent call last): [ 931.821995] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 931.821995] env[69847]: return func(*args, **kwargs) [ 931.821995] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 931.821995] env[69847]: res.raise_for_status() [ 931.821995] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 931.821995] env[69847]: raise HTTPError(http_error_msg, response=self) [ 931.821995] env[69847]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b375832-9bc0-466c-b5af-483563b98390 [ 931.821995] env[69847]: During handling of the above exception, another exception occurred: [ 931.821995] env[69847]: Traceback (most recent call last): [ 931.822584] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 931.822584] env[69847]: listener.cb(fileno) [ 931.822584] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 931.822584] env[69847]: result = function(*args, **kwargs) [ 931.822584] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 931.822584] env[69847]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 931.822584] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 931.822584] env[69847]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 931.822584] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 931.822584] env[69847]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 931.822584] env[69847]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 931.822584] env[69847]: res.raise_for_status() [ 931.822584] env[69847]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 931.822584] env[69847]: raise HTTPError(http_error_msg, response=self) [ 931.822584] env[69847]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1b375832-9bc0-466c-b5af-483563b98390 [ 931.822584] env[69847]: Removing descriptor: 62 [ 932.305418] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.807889] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.808069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.808250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.808425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.809121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.809121] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be updated. [ 932.835020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.835346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.835441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.835710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.835900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.844093] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 933.239810] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 933.240667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.240667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.240667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.240976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.241956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.241956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.241956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.241956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.241956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.241956] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.243370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.243370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.243370] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.243370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.243370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.243370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.243370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.243701] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.745334] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.745884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.745884] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.798463] env[69847]: INFO networking_nsxv3.common.synchronization [req-4f41350b-cef0-4b15-a397-9f073522bcb4 req-35ab0981-d1dc-4a1b-859c-9909a71efdc2 tempest-InstanceActionsTestJSON-679254814 tempest-InstanceActionsTestJSON-679254814-project-member] Enqueued Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_members [ 933.799877] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGHEST for action security_group_members [ 933.800235] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.800352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.800415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.800607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.800789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.800885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.800943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.801106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.801184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.801273] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.863699] env[69847]: INFO networking_nsxv3.common.synchronization [req-a2c069c6-3980-43a0-823b-815a2694c2d2 req-09373ac4-4fae-4b63-acae-512ea3f44150 tempest-ServerRescueTestJSONUnderV235-122762212 tempest-ServerRescueTestJSONUnderV235-122762212-project-member] Enqueued Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 933.864834] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd with Priority: HIGHEST for action security_group_members [ 933.864834] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.864834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.248832] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.304142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.304142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.304556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.304556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.324945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.325316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.325463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.325548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.325842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.325939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.326054] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 is going to be updated. [ 934.353432] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.353676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.353676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.353956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.354361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.363329] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 in Status: IN_PROGRESS for 2s [ 934.451829] env[69847]: INFO networking_nsxv3.common.synchronization [req-40585af9-470c-4982-91d7-7dc1ac1b03c0 req-f89f6852-272d-4884-ad26-acdc22fafba7 tempest-AttachInterfacesV270Test-893423146 tempest-AttachInterfacesV270Test-893423146-project-member] Enqueued Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_members [ 934.453056] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_members [ 934.453496] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.453786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.453880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.454273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.454454] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.454577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.454656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.454858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.454947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.455053] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.512938] env[69847]: INFO networking_nsxv3.common.synchronization [None req-fedbd518-5e60-49c6-9f78-5a650904d722 tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_rules [ 934.512984] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_rules [ 934.513287] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.513416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.513485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.513753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.513869] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.626201] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7fcee3e3-a97d-485f-a687-1f6f00f77d0f tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_rules [ 934.626696] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_rules [ 934.627037] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.627138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.755622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.755622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.755622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.755622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.755622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.755622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be updated. [ 934.785150] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.785150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.785150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.785150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.785150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.792116] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 934.856766] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.856766] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.856766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.856766] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.921284] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-519 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.921524] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-519" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.921699] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-519" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.922337] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-519" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.922726] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.923024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.923213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.923511] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.923719] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.924022] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.924223] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.924399] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.924582] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.924751] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.924907] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.925121] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.944162] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.944391] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.944541] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.944729] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-519" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.945106] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-c9670afa-ce64-4d07-b967-af9551cf66ad taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.945323] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.945451] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.946226] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.946462] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9670afa-ce64-4d07-b967-af9551cf66ad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.959493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.960724] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.960724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.961015] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 already deleted. [ 934.961015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.041945] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.042153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.042220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.042445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.042557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.042650] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 already deleted. [ 935.042710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.042992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.043798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.043798] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.361560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.361733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.361809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.361984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.362193] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.362313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.362374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.362531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.362629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.362700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.362924] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.363054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.363119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.363259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.363415] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.363505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.363563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.363785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.363933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.364025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.364137] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.449097] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.449292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.449357] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.449649] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.449843] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.449999] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port c9670afa-ce64-4d07-b967-af9551cf66ad not found, creating... [ 935.450286] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.450450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.450590] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.450848] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.451077] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.451327] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.451509] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.451631] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.451843] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.451982] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.452153] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: c9670afa-ce64-4d07-b967-af9551cf66ad is going to be created. [ 935.470939] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.471191] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.471317] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.471577] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.472006] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.472259] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.565764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.565967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.566022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.566264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.566359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.566460] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 already deleted. [ 935.566541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.866330] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d: rpc.has_security_group_logging(os_id): False [ 935.884054] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.884266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.884305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.884528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.905182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.905434] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.905615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.905690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.905920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.906040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.906298] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.906434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.906496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.906664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.906775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.907031] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.907172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.907244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.907415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.907497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.907608] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be updated. [ 935.965107] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.965107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.965327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.965498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.965654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.976742] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 936.168804] env[69847]: INFO networking_nsxv3.common.synchronization [req-40585af9-470c-4982-91d7-7dc1ac1b03c0 req-d3186578-0822-4cd6-88cf-e859e572c556 service nova] Enqueued Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_rules [ 936.168884] env[69847]: INFO networking_nsxv3.common.synchronization [req-40585af9-470c-4982-91d7-7dc1ac1b03c0 req-d3186578-0822-4cd6-88cf-e859e572c556 service nova] Enqueued Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_members [ 936.169034] env[69847]: INFO networking_nsxv3.common.synchronization [req-40585af9-470c-4982-91d7-7dc1ac1b03c0 req-d3186578-0822-4cd6-88cf-e859e572c556 service nova] Enqueued Resource ID: c9670afa-ce64-4d07-b967-af9551cf66ad with Priority: HIGHEST for action port [ 936.169514] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_rules [ 936.169659] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_members [ 936.169762] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9670afa-ce64-4d07-b967-af9551cf66ad with Priority: HIGHEST for action port [ 936.170203] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.170346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.170512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.170818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.170904] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.172572] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.172692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.172756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.172987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.173244] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.173305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.173348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.173489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.173590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.173685] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.174519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9670afa-ce64-4d07-b967-af9551cf66ad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.174641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.174686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.175361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.175361] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9670afa-ce64-4d07-b967-af9551cf66ad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.373853] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 in Status: SUCCESS [ 936.374094] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 deletion is rescheduled due to dependency. [ 936.374240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.677976] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.678515] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.678638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.678783] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9670afa-ce64-4d07-b967-af9551cf66ad with status ACTIVE [ 936.678947] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.679062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.679125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.679395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.679487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.679589] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.679685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.679746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.679900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.679986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.680440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.680570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.680640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.680804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.680878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.680969] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9670afa-ce64-4d07-b967-af9551cf66ad is going to be updated. [ 936.708872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.709071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.709132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.709351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.709491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.709650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9670afa-ce64-4d07-b967-af9551cf66ad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.802015] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 936.802210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.802323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.803133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.803133] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.803133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.803133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.803404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.803404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.803463] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.996288] env[69847]: INFO networking_nsxv3.common.synchronization [req-c25884ec-5a0e-4597-8597-105ccf8ebc59 req-f20382f2-31f7-467f-b410-b810ac0d79d6 tempest-VolumesAdminNegativeTest-613767114 tempest-VolumesAdminNegativeTest-613767114-project-member] Enqueued Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_members [ 936.996920] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_members [ 936.997277] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.997404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.997470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.997840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.997893] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.998078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.998078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.998200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.998280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.998370] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.184777] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.305832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.306057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.306120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.306397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.329531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.329828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.329995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.330084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.330350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.330477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.330597] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be updated. [ 937.342547] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.342837] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.343037] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.343364] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.343685] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.343996] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.344165] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.344420] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.344574] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.344891] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.345034] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.345166] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.345284] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.345402] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.345493] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.345628] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.365600] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.365855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.365855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.366019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.366256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.368904] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.369125] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 937.369328] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.369477] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-629" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.369775] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.369933] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.370071] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.370396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.370539] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419ce7fe-3a47-4003-8d9c-8dfde04d6f05',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.374599] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 937.501245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.501432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.501480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.501715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.501826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.502038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.502152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.502211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.502605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.502605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.502605] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 already deleted. [ 937.502883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.690781] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.690999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.690999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.691295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.691412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.691539] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 is going to be created. [ 937.713204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.713402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.713402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.713603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.713758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.723325] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 in Status: UNINITIALIZED for 2s [ 937.873177] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.873473] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.873603] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.873990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.874256] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.874645] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 419ce7fe-3a47-4003-8d9c-8dfde04d6f05 not found, creating... [ 937.874810] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.875032] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.875175] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.875441] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.875591] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.875901] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.876099] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.876225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.876449] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.876588] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.876731] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 419ce7fe-3a47-4003-8d9c-8dfde04d6f05 is going to be created. [ 937.894566] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.894886] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.894990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.895276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.895502] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.895732] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.998295] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 937.998688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.593135] env[69847]: INFO networking_nsxv3.common.synchronization [req-c25884ec-5a0e-4597-8597-105ccf8ebc59 req-191e2165-78ea-4bf1-a394-178205ef70cb service nova] Enqueued Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_rules [ 938.593422] env[69847]: INFO networking_nsxv3.common.synchronization [req-c25884ec-5a0e-4597-8597-105ccf8ebc59 req-191e2165-78ea-4bf1-a394-178205ef70cb service nova] Enqueued Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_members [ 938.593536] env[69847]: INFO networking_nsxv3.common.synchronization [req-c25884ec-5a0e-4597-8597-105ccf8ebc59 req-191e2165-78ea-4bf1-a394-178205ef70cb service nova] Enqueued Resource ID: 419ce7fe-3a47-4003-8d9c-8dfde04d6f05 with Priority: HIGHEST for action port [ 938.594194] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_rules [ 938.594403] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_members [ 938.594558] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 419ce7fe-3a47-4003-8d9c-8dfde04d6f05 with Priority: HIGHEST for action port [ 938.594940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.595100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.595136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.595468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.595594] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.597750] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.597876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.597946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.598263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.598478] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.598593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.598659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.598911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.599083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.599208] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.600668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.600842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.600946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.601128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.601222] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419ce7fe-3a47-4003-8d9c-8dfde04d6f05',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.098276] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.098712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.101802] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.105642] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 419ce7fe-3a47-4003-8d9c-8dfde04d6f05 with status ACTIVE [ 939.105922] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.106118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.106194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.106492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.106584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.106824] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.107253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.107253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.107461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.107461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.107686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.107782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.107853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.108012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.108091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.108202] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 419ce7fe-3a47-4003-8d9c-8dfde04d6f05 is going to be updated. [ 939.127368] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.127607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-419ce7fe-3a47-4003-8d9c-8dfde04d6f05" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.383943] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 939.384136] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd deletion is rescheduled due to dependency. [ 939.384254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.384413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.384629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.384812] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.384925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.384991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.385182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.385266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.385459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.385502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.385586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.385635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.385771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.385904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.385996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.386066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.386204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.386277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.386355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.386441] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.387277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.387449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.387591] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.387690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.387750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.387889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.387969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.388069] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.604443] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.735349] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 in Status: SUCCESS [ 939.735607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.735788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.736022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.736216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.736332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.736398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.736550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.736632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.736717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.736803] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.890345] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd: rpc.has_security_group_logging(os_id): False [ 939.891779] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.892187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.892303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.892541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.892681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.893653] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.893653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.893653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.893972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.893972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.894207] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be updated. [ 939.912376] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.913266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.913266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.913266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.913266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.913266] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.913266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.913519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.913519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.913617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.913761] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.913896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.913896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.914094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.914181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.914472] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.914545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.914627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.914744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.914851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.914947] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be updated. [ 939.920527] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.920675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.920675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.920867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.921071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.930227] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 939.986938] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.987117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.987245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.987572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.987777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.000400] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: IN_PROGRESS for 2s [ 940.106686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.107065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.107065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.107187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.107284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.107398] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 is going to be created. [ 940.136297] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.136455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.136561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.136748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.136965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.148244] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 in Status: UNINITIALIZED for 2s [ 940.238952] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.239177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.239232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.239463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.239635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.239737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.239801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.239961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.240049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.240139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.240315] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.240441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.240504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.240650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.240789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.240892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.240966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.241150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.241237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.241341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.241430] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.743656] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 464d4153-37e1-4ee4-acaa-e78786c77e75: rpc.has_security_group_logging(os_id): False [ 940.760894] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.761128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.761128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.761334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.761438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.761659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.761844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.761844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.762046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.762105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.762300] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.762388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.762481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.762698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.762698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.762934] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.763031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.763133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.763285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.763363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.763452] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 is going to be created. [ 940.815264] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.815420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.815469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.815683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.815860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.826809] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 in Status: IN_PROGRESS for 2s [ 941.846330] env[69847]: INFO networking_nsxv3.common.synchronization [req-999d6c09-4966-431f-8b22-3387c2e15e3b req-20dd3143-8981-45ea-8ca7-a71b9f2bde11 tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 941.848030] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 941.848030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.848030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.848030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.848030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.848348] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.848581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.848725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.850165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.850165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.850165] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.939782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 941.940051] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd deletion is rescheduled due to dependency. [ 941.940234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.011881] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd in Status: SUCCESS [ 942.011881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.011881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.011881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.012085] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.157408] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 in Status: SUCCESS [ 942.157733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.157976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.158316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.158604] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.159702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.159860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.161068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.161068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.161068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.161068] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.346576] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.346888] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.347072] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.347553] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.349728] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.349728] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.349728] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.351835] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.352152] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.352342] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.352469] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.352583] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.352697] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.352808] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.352921] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.353076] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.354665] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.354779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.354850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.355799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.355965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.356227] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.356383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.356497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.356736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.356860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.357110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff already deleted. [ 942.357110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.374673] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.376082] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.378021] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.378021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.378021] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-df1157d2-1a1b-46eb-a930-c64b1f229800 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.378021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.378021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.378021] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.378021] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1157d2-1a1b-46eb-a930-c64b1f229800',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.532917] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.532917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.532917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.532917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.532917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.532917] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd is going to be deleted. [ 942.577581] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.577758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.577828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.578106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.578209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.578334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d3bdb0d-29ff-4edb-9bfb-48a399f4cabd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.663599] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.664135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.664253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.664582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.664774] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.664891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.664966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.665150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.665260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.665419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.665864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.665999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.666065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.666191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.666333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.666427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.666483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.666621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.666698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.666780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.666868] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.839287] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 in Status: SUCCESS [ 942.839557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.881655] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.881990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.882039] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.882338] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.882503] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.882665] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port df1157d2-1a1b-46eb-a930-c64b1f229800 not found, creating... [ 942.882955] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.883282] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.883282] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.883489] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.883625] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.883914] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.885379] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.885584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.885874] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.886077] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.886540] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: df1157d2-1a1b-46eb-a930-c64b1f229800 is going to be created. [ 942.904892] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.905190] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.905465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.905550] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.905787] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.906041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.169256] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ddfb0ca-be41-4aab-86c8-f25898604880: rpc.has_security_group_logging(os_id): False [ 943.185923] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.186102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.186175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.186422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.186514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.186768] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.186856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.186856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.186999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.187089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.187318] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.187496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.187567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.187694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.187767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.187963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.188071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.188133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.188275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.188344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.188734] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 is going to be created. [ 943.244086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.244297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.244480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.244642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.244884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.259418] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 in Status: IN_PROGRESS for 2s [ 943.371041] env[69847]: INFO networking_nsxv3.common.synchronization [None req-fdb6281f-6e8f-47f6-9827-1dde4fcae881 None None] Enqueued Resource ID: 4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce with Priority: HIGHEST for action port [ 943.371041] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce with Priority: HIGHEST for action port [ 943.371041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.371041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.371041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.371041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.371041] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.671299] env[69847]: INFO networking_nsxv3.common.synchronization [req-999d6c09-4966-431f-8b22-3387c2e15e3b req-9b0e14cc-1695-4599-bebd-e6e2e57ce483 service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 943.671299] env[69847]: INFO networking_nsxv3.common.synchronization [req-999d6c09-4966-431f-8b22-3387c2e15e3b req-9b0e14cc-1695-4599-bebd-e6e2e57ce483 service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 943.671299] env[69847]: INFO networking_nsxv3.common.synchronization [req-999d6c09-4966-431f-8b22-3387c2e15e3b req-9b0e14cc-1695-4599-bebd-e6e2e57ce483 service nova] Enqueued Resource ID: df1157d2-1a1b-46eb-a930-c64b1f229800 with Priority: HIGHEST for action port [ 943.671299] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 943.671591] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 943.671857] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1157d2-1a1b-46eb-a930-c64b1f229800 with Priority: HIGHEST for action port [ 943.672324] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.672625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.672859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.673241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.673430] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.674611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.674854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.675038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.675362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.677232] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.677717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.678545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.678787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.678896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.679059] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.683086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-df1157d2-1a1b-46eb-a930-c64b1f229800 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.683276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.683344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.683558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.683635] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1157d2-1a1b-46eb-a930-c64b1f229800',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.874433] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce [ 943.874688] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.874828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.874897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.875530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.875530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.875530] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce already deleted. [ 943.875530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bdf70d9-ea45-466d-b7e2-1d7554fdf4ce" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.186868] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df1157d2-1a1b-46eb-a930-c64b1f229800 with status ACTIVE [ 944.187166] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.187259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.187324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.187546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.187638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.187822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.187947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.188025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.188183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.188264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.188449] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.188543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.188604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.188744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.189046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.189046] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df1157d2-1a1b-46eb-a930-c64b1f229800 is going to be updated. [ 944.191422] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.191730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.191938] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.216137] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.216137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.216137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.216137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.216344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.216419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df1157d2-1a1b-46eb-a930-c64b1f229800" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.676128] env[69847]: INFO networking_nsxv3.common.synchronization [req-f43afcba-d464-40b9-9013-09dfba843bc4 req-585fefed-c9c1-4abf-a024-5bd0e441232c tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 944.678474] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 944.679848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.679848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.696019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.198528] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.198803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.199025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.199312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.200709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.200709] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be created. [ 945.206815] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.207081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.207272] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.207728] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.208118] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.208387] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.208601] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.208903] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.209212] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.209560] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.209699] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.209815] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.213028] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.213028] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.213028] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.213028] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.231789] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.231892] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.233058] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.233058] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.233058] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-662ea912-878e-43b8-ae2f-81ef83e1bfc2 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.233867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.235185] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.235185] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.235185] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('662ea912-878e-43b8-ae2f-81ef83e1bfc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.237436] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.237657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.237766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.238174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.238372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.247469] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: UNINITIALIZED for 2s [ 945.269131] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 in Status: SUCCESS [ 945.269377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.552007] env[69847]: INFO networking_nsxv3.common.synchronization [None req-045e9d9b-dd1b-4fa9-84d4-e549e5b9105f None None] Enqueued Resource ID: 66ff3462-db6a-4409-a4fc-b635b4c100f2 with Priority: HIGHEST for action port [ 945.552300] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ff3462-db6a-4409-a4fc-b635b4c100f2 with Priority: HIGHEST for action port [ 945.553233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-66ff3462-db6a-4409-a4fc-b635b4c100f2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.553233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66ff3462-db6a-4409-a4fc-b635b4c100f2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.553233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66ff3462-db6a-4409-a4fc-b635b4c100f2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.553519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66ff3462-db6a-4409-a4fc-b635b4c100f2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.553519] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66ff3462-db6a-4409-a4fc-b635b4c100f2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.740933] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.741312] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.741492] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.741825] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.742092] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.742247] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 662ea912-878e-43b8-ae2f-81ef83e1bfc2 not found, creating... [ 945.742600] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.742836] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.743070] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.743668] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.743668] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.743785] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.743946] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.744178] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.744411] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.744556] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.744701] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 662ea912-878e-43b8-ae2f-81ef83e1bfc2 is going to be created. [ 945.762352] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.762637] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.762773] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.763154] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.763390] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.763626] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.055384] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66ff3462-db6a-4409-a4fc-b635b4c100f2 [ 946.055483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.055606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.055754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.055921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.056380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.056380] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66ff3462-db6a-4409-a4fc-b635b4c100f2 already deleted. [ 946.056380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66ff3462-db6a-4409-a4fc-b635b4c100f2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.439239] env[69847]: INFO networking_nsxv3.common.synchronization [req-f43afcba-d464-40b9-9013-09dfba843bc4 req-be14c869-67c5-4183-98ae-02de3183a530 service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 946.439488] env[69847]: INFO networking_nsxv3.common.synchronization [req-f43afcba-d464-40b9-9013-09dfba843bc4 req-be14c869-67c5-4183-98ae-02de3183a530 service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 946.439575] env[69847]: INFO networking_nsxv3.common.synchronization [req-f43afcba-d464-40b9-9013-09dfba843bc4 req-be14c869-67c5-4183-98ae-02de3183a530 service nova] Enqueued Resource ID: 662ea912-878e-43b8-ae2f-81ef83e1bfc2 with Priority: HIGHEST for action port [ 946.439803] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 946.439926] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 946.440029] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662ea912-878e-43b8-ae2f-81ef83e1bfc2 with Priority: HIGHEST for action port [ 946.440548] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.440649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.440841] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.440920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.441145] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-662ea912-878e-43b8-ae2f-81ef83e1bfc2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.441252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.441313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.441506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.441588] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('662ea912-878e-43b8-ae2f-81ef83e1bfc2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.943655] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 662ea912-878e-43b8-ae2f-81ef83e1bfc2 with status ACTIVE [ 946.943655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.943861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.943861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.944193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.944287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.944473] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.944573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.944635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.944787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.944863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.945061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.945161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.945249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.945403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.945477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.945563] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 662ea912-878e-43b8-ae2f-81ef83e1bfc2 is going to be updated. [ 946.971738] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.971900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.971988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.972234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.972527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.972527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-662ea912-878e-43b8-ae2f-81ef83e1bfc2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.080289] env[69847]: INFO networking_nsxv3.common.synchronization [req-a25ecc0c-c8dc-4044-b842-a5457098e23a req-26ae219e-67ef-461a-865f-d9632bb0a694 tempest-ServerMetadataTestJSON-1060364577 tempest-ServerMetadataTestJSON-1060364577-project-member] Enqueued Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_members [ 947.080996] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_members [ 947.081307] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.081439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.081506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.081764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.082112] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.082112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.082112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.082253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.082327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.082418] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.260215] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 947.260425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.260939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.260939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.261135] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.261135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.265695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.266058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.266161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.266258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.266363] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.267269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.268187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.268187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.268187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.268187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.268187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.268187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.268187] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.394045] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-531" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-531" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-531" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.396665] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.396665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.396665] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.396665] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.397610] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.397610] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.397610] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.397610] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.397800] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.415250] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.415420] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.415563] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.415742] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-531" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.416217] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-24ae0d78-0100-4e50-878c-21e529430d10 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.416328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.416374] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.416687] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.416855] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24ae0d78-0100-4e50-878c-21e529430d10',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.584995] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.585336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.585336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.585473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.585566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.585760] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.585853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.585921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.586120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.586198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.586287] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8274668c-f732-47b5-a698-409c1e7afb7c already deleted. [ 947.586368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.769522] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.769707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.769868] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.920491] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.920739] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.920854] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.921170] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.921328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.921516] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 24ae0d78-0100-4e50-878c-21e529430d10 not found, creating... [ 947.921793] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.921955] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.922095] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.922378] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.922544] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.922833] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.923050] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.923200] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.923419] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.923556] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.923697] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 24ae0d78-0100-4e50-878c-21e529430d10 is going to be created. [ 947.942369] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.942587] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.942678] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.942992] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.943269] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.943497] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.272251] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.677693] env[69847]: INFO networking_nsxv3.common.synchronization [req-a25ecc0c-c8dc-4044-b842-a5457098e23a req-3fe9e2c5-8d4c-4b91-9c93-c5ee9accc8de service nova] Enqueued Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_rules [ 948.677959] env[69847]: INFO networking_nsxv3.common.synchronization [req-a25ecc0c-c8dc-4044-b842-a5457098e23a req-3fe9e2c5-8d4c-4b91-9c93-c5ee9accc8de service nova] Enqueued Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_members [ 948.678125] env[69847]: INFO networking_nsxv3.common.synchronization [req-a25ecc0c-c8dc-4044-b842-a5457098e23a req-3fe9e2c5-8d4c-4b91-9c93-c5ee9accc8de service nova] Enqueued Resource ID: 24ae0d78-0100-4e50-878c-21e529430d10 with Priority: HIGHEST for action port [ 948.678260] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_rules [ 948.678387] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_members [ 948.678483] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24ae0d78-0100-4e50-878c-21e529430d10 with Priority: HIGHEST for action port [ 948.679126] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.679261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.679328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.679585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.679669] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.680536] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.680584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.680653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.680796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.680976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.681122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.681122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.681220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.681306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.681411] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.682105] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-24ae0d78-0100-4e50-878c-21e529430d10 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.682480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.682480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.682480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.682790] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24ae0d78-0100-4e50-878c-21e529430d10',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.775081] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.775309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.775391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.775620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.775715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.775957] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 948.803175] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.803719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.803719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.803719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.803846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.811513] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 949.184453] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.185147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.185147] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.186055] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24ae0d78-0100-4e50-878c-21e529430d10 with status ACTIVE [ 949.186278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.186465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.186465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.186744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.186850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.187075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.187197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.187241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.187449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.187508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.187733] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.187839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.188144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.188144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.188232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.188258] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24ae0d78-0100-4e50-878c-21e529430d10 is going to be updated. [ 949.225742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.225742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.225742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.225742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.225742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.225742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24ae0d78-0100-4e50-878c-21e529430d10" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.690958] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.197673] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.197673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.197673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.197673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.197673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.197673] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8274668c-f732-47b5-a698-409c1e7afb7c is going to be created. [ 950.225295] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.225295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.225295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.225295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.225295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.232179] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8274668c-f732-47b5-a698-409c1e7afb7c in Status: UNINITIALIZED for 2s [ 950.821098] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 950.821450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.821679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.821772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.821885] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.822019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.822073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.822231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.822311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.822422] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.328511] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.429378] env[69847]: INFO networking_nsxv3.common.synchronization [req-38b134f9-333b-4de1-a87c-f4c178e021b8 req-f85c6227-b209-4891-a5c1-da9e0cd8c16b tempest-AttachInterfacesV270Test-893423146 tempest-AttachInterfacesV270Test-893423146-project-member] Enqueued Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_members [ 951.429938] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGHEST for action security_group_members [ 951.430302] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.430444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.430508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.430710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.430881] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.430977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.431045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.431216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.431297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.431385] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.832662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.934343] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.934495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.934567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.934796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.934891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.935846] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.935846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.935846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.936046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.936046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.936046] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 is going to be updated. [ 951.961290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.961888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.968076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.968076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.968076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.977539] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 in Status: IN_PROGRESS for 2s [ 952.247649] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8274668c-f732-47b5-a698-409c1e7afb7c in Status: SUCCESS [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.247649] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.247649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.247649] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.334326] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.334525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.334618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.334880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.335008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.335168] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 952.361355] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.361555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.361555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.361862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.362043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.372516] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 952.750181] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.750356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.750450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.750671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.750840] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.750962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.751060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.751228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.751316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.751406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.751550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.751641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.751690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.751848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.752040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.752181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.752263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.752408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.752488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.752569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.752670] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.259026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8274668c-f732-47b5-a698-409c1e7afb7c: rpc.has_security_group_logging(os_id): False [ 953.277086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.277234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.277289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.277734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.277734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.277870] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.279101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.279451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.279451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.279451] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8274668c-f732-47b5-a698-409c1e7afb7c is going to be created. [ 953.363157] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.363302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.363484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.363567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.363746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.391788] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8274668c-f732-47b5-a698-409c1e7afb7c in Status: IN_PROGRESS for 2s [ 953.510118] env[69847]: INFO networking_nsxv3.common.synchronization [req-0470eaee-2d94-4b5f-b671-cc40a2810769 req-c1aac697-2953-4b79-b55d-2fead976f358 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 953.510303] env[69847]: INFO networking_nsxv3.common.synchronization [req-0470eaee-2d94-4b5f-b671-cc40a2810769 req-c1aac697-2953-4b79-b55d-2fead976f358 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_members [ 953.510487] env[69847]: INFO networking_nsxv3.common.synchronization [req-0470eaee-2d94-4b5f-b671-cc40a2810769 req-c1aac697-2953-4b79-b55d-2fead976f358 tempest-SecurityGroupsTestJSON-587870158 tempest-SecurityGroupsTestJSON-587870158-project-member] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 953.512848] env[69847]: INFO networking_nsxv3.common.synchronization [req-198ebe44-a8aa-4b81-9c6b-b1c1d0155cb4 req-c2918ec2-90fd-4077-9c4f-9cbcc17c96fa tempest-VolumesAdminNegativeTest-613767114 tempest-VolumesAdminNegativeTest-613767114-project-member] Enqueued Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_members [ 953.513240] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGHEST for action security_group_members [ 953.513378] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGHEST for action security_group_members [ 953.513474] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGHEST for action security_group_members [ 953.515019] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGHEST for action security_group_members [ 953.515019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.515019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.515019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.515019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.516713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.516821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.516886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.517102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.517215] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.517308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.517378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.517617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.517708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.517798] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.518673] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.518767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.518852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.519227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.520268] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.520420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.520510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.520712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.520810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.521275] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.526209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.526414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.526414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.527086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.527086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.527086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.527086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.527086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.527347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.527347] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.987419] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 in Status: SUCCESS [ 953.987678] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 deletion is rescheduled due to dependency. [ 953.987737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.017397] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.017592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.017688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.017982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.029208] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.029428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.029805] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.030016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.030357] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.030485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.035567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.036078] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.036223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.036264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.036469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.036549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.036655] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be updated. [ 954.037766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.037952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.063411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.063987] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.063987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.065126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.065441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.066574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.066574] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be updated. [ 954.068796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.068796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.073264] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.073264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.074584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.074584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.074844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.088438] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: IN_PROGRESS for 2s [ 954.090459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.090711] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.090829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.090943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.094359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.094635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.097043] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 is going to be updated. [ 954.097043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.097043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.097043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.097043] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.097337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.097337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.097657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.097872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.099026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 is going to be updated. [ 954.104022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.104227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.104316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.104555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.104725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.114113] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: IN_PROGRESS for 2s [ 954.135887] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.135887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.135887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.135887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.135887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.138820] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.138820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.138820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.138820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.138820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.151278] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: IN_PROGRESS for 2s [ 954.153141] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 in Status: IN_PROGRESS for 2s [ 954.305157] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebc7fe38-dfc3-4eaf-9a60-5ec2fcefc92b req-dc1c7e2b-8b57-4398-8723-c1ed20cf0068 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_members [ 954.306227] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_members [ 954.306668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.306926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.307097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.307511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.309083] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.309083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.309083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.309083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.309083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.309083] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.381809] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 954.382054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.382237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.382455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.382645] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.382762] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.382828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.382991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.384188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.384188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.384188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.384871] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.810481] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.810687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.810748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.811150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.811150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.811407] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.811407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.811639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.811639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.811846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.811846] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 already deleted. [ 954.811846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.886558] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 320d8032-7c7f-4adf-9aaa-d27d0fb2efff: rpc.has_security_group_logging(os_id): False [ 954.908519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.908519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.908519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.908519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.911388] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.911388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.911388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.911388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.911388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.911388] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be created. [ 954.953499] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.953499] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.953499] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.953499] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.953842] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.953842] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.954519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.954519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.954519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.954674] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.954792] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.954929] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.955072] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.955293] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.955397] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.955537] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.964827] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.964957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.965682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.965682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.965682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.977558] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.977558] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.977558] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.977558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.977558] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.977558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.977558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.977558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.977558] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c3f5a4b-996c-4fac-92e0-ea2dc92258e1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.978172] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 955.406194] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8274668c-f732-47b5-a698-409c1e7afb7c in Status: SUCCESS [ 955.406512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.483107] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.483107] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.483362] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.483691] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.483906] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.484151] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 not found, creating... [ 955.484537] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.490424] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.490424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.490424] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 is going to be created. [ 955.506768] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.506866] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.506988] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.507285] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.507516] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.507852] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.098044] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 in Status: SUCCESS [ 956.101723] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 deletion is rescheduled due to dependency. [ 956.101723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.120644] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c88aae7-5837-4451-89b6-8972ab00f699 in Status: SUCCESS [ 956.120644] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 deletion is rescheduled due to dependency. [ 956.120644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.161803] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 in Status: SUCCESS [ 956.161803] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 deletion is rescheduled due to dependency. [ 956.161964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.162594] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 in Status: SUCCESS [ 956.162759] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 deletion is rescheduled due to dependency. [ 956.163498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.479792] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebc7fe38-dfc3-4eaf-9a60-5ec2fcefc92b req-7d669a4a-41c4-4987-af89-93251af5bb33 service nova] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_rules [ 956.480079] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebc7fe38-dfc3-4eaf-9a60-5ec2fcefc92b req-7d669a4a-41c4-4987-af89-93251af5bb33 service nova] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_members [ 956.480176] env[69847]: INFO networking_nsxv3.common.synchronization [req-ebc7fe38-dfc3-4eaf-9a60-5ec2fcefc92b req-7d669a4a-41c4-4987-af89-93251af5bb33 service nova] Enqueued Resource ID: 6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 with Priority: HIGHEST for action port [ 956.480394] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_rules [ 956.481458] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_members [ 956.481458] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 with Priority: HIGHEST for action port [ 956.483460] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.483606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.483671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.483881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.483961] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.485043] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.485174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.485244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.485465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.485852] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.485852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.485852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.486016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.486016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.486083] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.487441] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.487441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.487441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.487441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.487441] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c3f5a4b-996c-4fac-92e0-ea2dc92258e1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.944872] env[69847]: INFO networking_nsxv3.common.synchronization [req-1f515d7e-71c3-40fc-8eba-a12155838639 req-bb7a05f9-4aa5-4685-8804-6ef8d760c5ea tempest-ServerActionsV293TestJSON-414194083 tempest-ServerActionsV293TestJSON-414194083-project-member] Enqueued Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_members [ 956.945077] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_members [ 956.945694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.945694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.945694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.945919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.946135] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.946265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.946350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.946529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.946640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.946755] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.992022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.992022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.992022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 with status ACTIVE [ 956.992022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.992022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.992022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.992022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.992022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.992022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.993305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.993305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.993305] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c3f5a4b-996c-4fac-92e0-ea2dc92258e1 is going to be updated. [ 956.996948] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.000739] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 957.000739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.000739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.000739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.000739] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.017551] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.017698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.017770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.018018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.018168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.018327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c3f5a4b-996c-4fac-92e0-ea2dc92258e1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.453435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.456018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.456018] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d already deleted. [ 957.456018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.502861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.503195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.503292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.507025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.507025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.507025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.507025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.507025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.507025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.507025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.507025] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.507025] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.791962] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.792193] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-916" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.792321] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-916" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.792705] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-916" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.792966] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.793267] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.793397] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.793625] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.793780] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.793999] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.794126] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.794253] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.794363] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.794475] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.794586] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.794714] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.818024] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.818024] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.818024] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.818024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-916" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.818024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-72957f18-e8cc-423a-8a71-e1b5f534a795 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.818024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.818024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.818024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.818024] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72957f18-e8cc-423a-8a71-e1b5f534a795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.008115] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.008329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.008390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.008578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.008877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.008877] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 is going to be created. [ 958.010433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.010573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.010647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.010858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.011106] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.012038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.012038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.012038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.012038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.012038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.012038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.012038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.012419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.012419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.012419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.012593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.012593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.012728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.012839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.012947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.013126] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.045566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.045566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.045566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.045755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.045787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.056585] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 in Status: UNINITIALIZED for 2s [ 958.322176] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.322176] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.322176] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.322176] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.322342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.322473] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 72957f18-e8cc-423a-8a71-e1b5f534a795 not found, creating... [ 958.322675] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.322840] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.322957] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.323377] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.323542] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.323850] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.324037] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.324186] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.324446] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.324585] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.324724] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 72957f18-e8cc-423a-8a71-e1b5f534a795 is going to be created. [ 958.353555] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.355156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.355156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.355156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.355156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.355156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.516036] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 320d8032-7c7f-4adf-9aaa-d27d0fb2efff: rpc.has_security_group_logging(os_id): False [ 958.542596] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.542781] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.542853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.543172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.543293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.543513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.543620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.543685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.543874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.543973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.544212] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.544316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.544379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.544588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.544687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.544920] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.545034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.545114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.545283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.545377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.545487] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 958.616340] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.616502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.616559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.616795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.616943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.630915] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 959.902103] env[69847]: INFO networking_nsxv3.common.synchronization [req-1f515d7e-71c3-40fc-8eba-a12155838639 req-f7233cc4-b849-43b1-a2ff-13fcd7349b40 service nova] Enqueued Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_rules [ 959.902378] env[69847]: INFO networking_nsxv3.common.synchronization [req-1f515d7e-71c3-40fc-8eba-a12155838639 req-f7233cc4-b849-43b1-a2ff-13fcd7349b40 service nova] Enqueued Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_members [ 959.902378] env[69847]: INFO networking_nsxv3.common.synchronization [req-1f515d7e-71c3-40fc-8eba-a12155838639 req-f7233cc4-b849-43b1-a2ff-13fcd7349b40 service nova] Enqueued Resource ID: 72957f18-e8cc-423a-8a71-e1b5f534a795 with Priority: HIGHEST for action port [ 959.903478] env[69847]: INFO networking_nsxv3.common.synchronization [req-e4ff1772-8e39-4563-bbd3-f840bdcdeb60 req-f5a1256e-8bd9-408b-847d-fc1a04a4fee2 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 959.904133] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_rules [ 959.904133] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72957f18-e8cc-423a-8a71-e1b5f534a795 with Priority: HIGHEST for action port [ 959.904259] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_members [ 959.904332] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 959.904856] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.904981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.905062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.905268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.905346] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.906182] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-72957f18-e8cc-423a-8a71-e1b5f534a795 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.906299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.906387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.906564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.906640] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72957f18-e8cc-423a-8a71-e1b5f534a795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.908762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.909902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.909902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.909902] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.911284] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.911284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.911284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.911519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.911587] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.911684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.911928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.911928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.912029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.912127] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.066745] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 in Status: SUCCESS [ 960.066912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.067095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.067321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.067515] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.067629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.067719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.067843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.067924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.068022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.068135] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.414843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.415100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.415265] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72957f18-e8cc-423a-8a71-e1b5f534a795 with status ACTIVE [ 960.415475] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.415624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.415684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.415887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.415977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.416168] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.416259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.416315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.416471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.416548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.416723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.416878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.416951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.417160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.417244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.417329] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72957f18-e8cc-423a-8a71-e1b5f534a795 is going to be updated. [ 960.418404] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.419836] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.419984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.420071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.420229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.420315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.420526] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.420574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.420626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.420891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.420965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.421098] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 already deleted. [ 960.421270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.445454] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.445454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.445454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.445454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.445613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.446089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72957f18-e8cc-423a-8a71-e1b5f534a795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.571913] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.657707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 960.657707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.712461] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-864 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.712461] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-864" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.712461] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-864" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.712829] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-864" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.713323] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.713544] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.713844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.714135] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.714302] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.714523] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.714639] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.714750] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.714862] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.714973] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.715108] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.715252] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.733966] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.734229] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.734403] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.734609] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-864" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.734961] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-02aca41c-3d71-4830-b576-0acd93f13063 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.735162] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.735319] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.735754] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.735901] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02aca41c-3d71-4830-b576-0acd93f13063',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.925877] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.075079] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dab7dc1-01c6-41fb-8400-c0b26437fd97: rpc.has_security_group_logging(os_id): False [ 961.097822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.097822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.097822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.097822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.097822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.097822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.097822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.097822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.098211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.098211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.098292] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 is going to be created. [ 961.160950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.160950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.160950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.162044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.162044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.175700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 in Status: IN_PROGRESS for 2s [ 961.238715] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.238715] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.238893] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.239210] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.239368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.239526] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 02aca41c-3d71-4830-b576-0acd93f13063 not found, creating... [ 961.239791] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.239960] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.240107] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.240325] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.240468] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.242084] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.242084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.242084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.242084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.242084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.242084] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 02aca41c-3d71-4830-b576-0acd93f13063 is going to be created. [ 961.265899] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.266186] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.266254] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.266541] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.266850] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.267096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.426152] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.426347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.426398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.426588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.426678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.426777] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d is going to be created. [ 961.469516] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.469516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.469516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.469735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.469896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.480416] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d in Status: UNINITIALIZED for 2s [ 962.103334] env[69847]: INFO networking_nsxv3.common.synchronization [req-e4ff1772-8e39-4563-bbd3-f840bdcdeb60 req-a7b04d5d-dad0-49b3-9d22-c165b5d31cc2 service nova] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 962.103680] env[69847]: INFO networking_nsxv3.common.synchronization [req-e4ff1772-8e39-4563-bbd3-f840bdcdeb60 req-a7b04d5d-dad0-49b3-9d22-c165b5d31cc2 service nova] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 962.103831] env[69847]: INFO networking_nsxv3.common.synchronization [req-e4ff1772-8e39-4563-bbd3-f840bdcdeb60 req-a7b04d5d-dad0-49b3-9d22-c165b5d31cc2 service nova] Enqueued Resource ID: 02aca41c-3d71-4830-b576-0acd93f13063 with Priority: HIGHEST for action port [ 962.104560] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 962.104753] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 962.104915] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca41c-3d71-4830-b576-0acd93f13063 with Priority: HIGHEST for action port [ 962.105313] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.105440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.105550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.105814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.105917] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.106976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.107097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.107164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.111076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.111076] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.111076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-02aca41c-3d71-4830-b576-0acd93f13063 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.111076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.111076] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02aca41c-3d71-4830-b576-0acd93f13063',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.302359] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-e8768936-8cdb-4207-9907-fd4f3c8b3bee tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 962.302950] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 962.303305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.303426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.303488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.304778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.304943] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.305057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.305195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.305373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.305455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.305614] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.613657] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.613657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.613657] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.614458] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02aca41c-3d71-4830-b576-0acd93f13063 with status ACTIVE [ 962.614458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.614564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.614611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.614811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.614893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.615090] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.615279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.615279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.616703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.616703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.616703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.616703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.616703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.616703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.616703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.617108] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02aca41c-3d71-4830-b576-0acd93f13063 is going to be updated. [ 962.641355] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.641484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.641582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.641765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.641896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.643502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.814255] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.814255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.814255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.814255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.832249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.832855] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.832855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.832855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.833063] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.833063] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.834609] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 962.858152] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.858152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.858152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.858152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.858152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.871390] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 962.879086] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.879558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.879780] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.880148] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.880665] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.880885] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.881065] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.881385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.881551] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.881809] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.881976] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.882141] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.882282] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.882504] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.882657] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.882845] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.900440] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.900679] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.900848] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.901106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.901535] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.901855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.902031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.902703] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.902773] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f2c0be-a2c7-431a-9548-4b5c8dc7a370',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.119181] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.201876] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 in Status: SUCCESS [ 963.202315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.407736] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.408011] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.408148] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.412925] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 not found, creating... [ 963.412925] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.412925] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.412925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.413428] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.413428] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.413428] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.413428] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 is going to be created. [ 963.432526] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.432855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.433016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.433345] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.433581] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.433819] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.493432] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d in Status: SUCCESS [ 963.493660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.493828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.494056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.494256] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.494372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.494438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.494636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.494669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.494747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.494836] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.622262] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.622502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.622640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.622968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.623143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.623316] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be created. [ 963.646247] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.646247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.646247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.646247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.646247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.656437] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: UNINITIALIZED for 2s [ 964.002018] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.501547] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d: rpc.has_security_group_logging(os_id): False [ 964.517893] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.518101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.518168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.518478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.518590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.518908] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.519087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.519162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.519402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.519505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.519623] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d is going to be created. [ 964.574075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.574244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.574286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.574497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.574676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.584160] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d in Status: IN_PROGRESS for 2s [ 964.634165] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-55a69a44-3d13-4001-9054-ad5e8c006c80 service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 964.634165] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-55a69a44-3d13-4001-9054-ad5e8c006c80 service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 964.634246] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-55a69a44-3d13-4001-9054-ad5e8c006c80 service nova] Enqueued Resource ID: d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 with Priority: HIGHEST for action port [ 964.634964] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 964.634964] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 964.634964] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 with Priority: HIGHEST for action port [ 964.636301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.636439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.636603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.636765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.636860] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.637668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.637766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.637960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.638069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.638133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.638307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.638420] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2f2c0be-a2c7-431a-9548-4b5c8dc7a370',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.646690] env[69847]: INFO networking_nsxv3.common.synchronization [req-2cbec19e-f869-4d51-831a-0f7655f4712e req-62ab8b40-2a4b-4bae-8236-463717a624ad tempest-ServerMetadataTestJSON-1060364577 tempest-ServerMetadataTestJSON-1060364577-project-member] Enqueued Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_members [ 964.646859] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGHEST for action security_group_members [ 964.647655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.647743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.647860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.651458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.651458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.651458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.651458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.651458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.651458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.651458] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.881257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 964.881257] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e deletion is rescheduled due to dependency. [ 964.881257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.881257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.881550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.882026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.882026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.882026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.882200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.882200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.882274] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.146019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 with status ACTIVE [ 965.146019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.146019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.146019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.146019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.146019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2f2c0be-a2c7-431a-9548-4b5c8dc7a370 is going to be updated. [ 965.147743] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.148557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.155865] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.155865] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.155865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.155865] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8274668c-f732-47b5-a698-409c1e7afb7c is going to be updated. [ 965.179251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.179477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.179545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.179789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.179978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.180226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2f2c0be-a2c7-431a-9548-4b5c8dc7a370" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.223462] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.223462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.223462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.223462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.223656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.237258] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8274668c-f732-47b5-a698-409c1e7afb7c in Status: IN_PROGRESS for 2s [ 965.388546] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.665041] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: SUCCESS [ 965.665330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.665496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.665738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.666125] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.666125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.666125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.666316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.666374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.666463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.666570] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.892189] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.168782] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.393558] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.393700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.393752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.394034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.394146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.394310] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 966.422214] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.422214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.422214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.422214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.422214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.428843] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 966.596437] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d in Status: SUCCESS [ 966.596812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.672013] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a5d4244-b087-44e4-8f75-cde4173fe0e5: rpc.has_security_group_logging(os_id): False [ 966.691915] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.692077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.692184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.692697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.692697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.696434] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.696571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.696625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.696793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.696880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.696975] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be created. [ 966.754776] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.754920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.754991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.755227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.755420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.771664] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: IN_PROGRESS for 2s [ 967.250654] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8274668c-f732-47b5-a698-409c1e7afb7c in Status: SUCCESS [ 967.250654] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8274668c-f732-47b5-a698-409c1e7afb7c deletion is rescheduled due to dependency. [ 967.250654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.440158] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 968.440158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.440158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.440158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.440158] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.440158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.440158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.440641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.440641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.440641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.440641] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.788213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: SUCCESS [ 968.788490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.943931] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.944098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.944197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.945088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.945257] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.945499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.945499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.945636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.945729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.945818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.945964] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.946099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.946167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.946303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.946523] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.946676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.946744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.946983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.946983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.947087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.947849] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.452481] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72471c75-08a5-45be-9362-d9463542469e: rpc.has_security_group_logging(os_id): False [ 969.468462] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.470132] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.470132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.470929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.475824] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.475824] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.475824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.475824] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 969.527020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.527724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.530022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.530022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.530022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.548055] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 969.648079] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 969.648332] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 971.124871] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-7a425010-d470-45ce-9af9-649668c4165c tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 971.124871] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 971.125296] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.126098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.126098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.126098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.126254] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.126350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.126441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.126635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.126756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.126880] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.563927] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 971.567403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.630141] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.128024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.128309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.128468] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.129165] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.129165] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.129294] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.129385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.129607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.129747] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.129980] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.130447] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.130447] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.130447] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.130447] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.130593] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.137048] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.137048] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.150234] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.150382] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.150521] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.150699] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-794" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.151044] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-57f9b33b-b016-453e-992f-ace72ead4815 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.151242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.151379] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.151709] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.151867] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f9b33b-b016-453e-992f-ace72ead4815',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.627604] env[69847]: INFO networking_nsxv3.common.synchronization [req-980ec892-3cd7-4063-9cd6-ddfd7519a3d3 req-6a07e227-bc1a-4794-83dd-251f3119f3c0 tempest-ImagesOneServerTestJSON-1247170315 tempest-ImagesOneServerTestJSON-1247170315-project-member] Enqueued Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_members [ 972.627945] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGHEST for action security_group_members [ 972.629682] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.630724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.630724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.630724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.630724] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.630724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.630968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.631045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.631191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.631363] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.641990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.641990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.641990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.641990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.642174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.642174] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 972.656722] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.657015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.657209] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.658340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.658340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.658340] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 57f9b33b-b016-453e-992f-ace72ead4815 not found, creating... [ 972.658340] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.658340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.658340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.658697] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.658697] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.658974] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.659130] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.659242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.659448] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.660993] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.661261] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 57f9b33b-b016-453e-992f-ace72ead4815 is going to be created. [ 972.670186] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.670488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.670564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.670976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.671173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.681296] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 972.684220] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.685385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.685385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.685385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.685385] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.685999] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.138098] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.138360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.138395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.138645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.160239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.160823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.160823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.160966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.162695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.162695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.162695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ca119d-bde2-4386-8868-06f3fb18260c is going to be updated. [ 973.193063] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.193318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.194343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.194343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.194343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.207415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ca119d-bde2-4386-8868-06f3fb18260c in Status: IN_PROGRESS for 2s [ 973.764939] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-5d4765ea-92fe-4e2f-834c-b5ce4975a5fb service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 973.765124] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-5d4765ea-92fe-4e2f-834c-b5ce4975a5fb service nova] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 973.765283] env[69847]: INFO networking_nsxv3.common.synchronization [req-3c21956a-5094-46c6-a40f-e24c7b2cd004 req-5d4765ea-92fe-4e2f-834c-b5ce4975a5fb service nova] Enqueued Resource ID: 57f9b33b-b016-453e-992f-ace72ead4815 with Priority: HIGHEST for action port [ 973.765527] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_rules [ 973.765660] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 973.765744] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f9b33b-b016-453e-992f-ace72ead4815 with Priority: HIGHEST for action port [ 973.766369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.766596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.766596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.766745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.766832] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.767699] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.767802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.769359] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-57f9b33b-b016-453e-992f-ace72ead4815 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.769359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.769359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.769359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.769359] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f9b33b-b016-453e-992f-ace72ead4815',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.270120] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.270433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.277678] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57f9b33b-b016-453e-992f-ace72ead4815 with status ACTIVE [ 974.277678] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.277678] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.277678] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.277678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.277678] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57f9b33b-b016-453e-992f-ace72ead4815 is going to be updated. [ 974.297616] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.298216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.298216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.298216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.298216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.298987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57f9b33b-b016-453e-992f-ace72ead4815" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.690014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 974.690014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.690014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.693296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.693296] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.693473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.693473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.693636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.693714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.693808] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.195533] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.224180] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8ca119d-bde2-4386-8868-06f3fb18260c in Status: SUCCESS [ 975.225063] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8ca119d-bde2-4386-8868-06f3fb18260c deletion is rescheduled due to dependency. [ 975.225063] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.698686] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.771198] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5d29581-060c-41c5-a410-a5aa42c8a1be req-9bef7a09-b66d-4b31-9e54-819b78b91498 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 975.771911] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 975.773035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.773035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.773035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.773035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.773035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.773035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.773035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.773402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.773402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.773402] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.109074] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.109074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.109074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.109074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.109074] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.109307] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.109307] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.110440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.110440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.110440] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.110440] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.110440] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.110440] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.110440] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 976.110695] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.110695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.130416] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.130416] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 976.130416] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.130523] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.130797] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-0b28ca40-713a-4364-8b20-030645d92a5c taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.131070] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.131233] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.131593] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.131834] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b28ca40-713a-4364-8b20-030645d92a5c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.203576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.203750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.203845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.204067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.204160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.204565] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 976.235208] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.235372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.235444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.235665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.235828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.244573] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 976.276035] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.634108] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.634405] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.634545] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.634831] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.635010] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.635220] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 0b28ca40-713a-4364-8b20-030645d92a5c not found, creating... [ 976.635445] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.635606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.635721] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.636219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.636219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.636366] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.636522] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.636640] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.636847] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.637020] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.637176] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 0b28ca40-713a-4364-8b20-030645d92a5c is going to be created. [ 976.660664] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.660884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.661019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.661294] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.661558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.661849] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.777842] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.281359] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.281604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.281718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.282020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.282167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.282332] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 977.311925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.312080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.312150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.312362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.312887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.323669] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 977.420329] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5d29581-060c-41c5-a410-a5aa42c8a1be req-3061abb1-3208-4ebc-9772-7609c08ffc15 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 977.420547] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5d29581-060c-41c5-a410-a5aa42c8a1be req-3061abb1-3208-4ebc-9772-7609c08ffc15 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 977.420692] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5d29581-060c-41c5-a410-a5aa42c8a1be req-3061abb1-3208-4ebc-9772-7609c08ffc15 service nova] Enqueued Resource ID: 0b28ca40-713a-4364-8b20-030645d92a5c with Priority: HIGHEST for action port [ 977.421974] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 977.421974] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 977.421974] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b28ca40-713a-4364-8b20-030645d92a5c with Priority: HIGHEST for action port [ 977.421974] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.421974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.422186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.422420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.422792] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.425027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.425027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.425027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b28ca40-713a-4364-8b20-030645d92a5c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.425027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.425027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.425027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.425027] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b28ca40-713a-4364-8b20-030645d92a5c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.926383] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b28ca40-713a-4364-8b20-030645d92a5c with status ACTIVE [ 977.926656] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.926867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.926932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.927193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.927267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.927497] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.927576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.928995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.928995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.928995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.929153] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.929257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.929310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.929768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.929768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.929768] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b28ca40-713a-4364-8b20-030645d92a5c is going to be updated. [ 977.930880] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.931008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.950249] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.950416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.950416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.951066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.951066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.951066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b28ca40-713a-4364-8b20-030645d92a5c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.254793] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 978.255017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.255202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.255869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.255869] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.255869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.255869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.256501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.256647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.256744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.256836] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.568318] env[69847]: INFO networking_nsxv3.common.synchronization [req-e7e75252-821e-4caf-97f8-36f688aad9e3 req-1c27b05b-c5c5-4059-afbe-12aa5bc7609b tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_members [ 978.568318] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_members [ 978.568318] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.568318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.568318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.568318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.568318] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.568318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.568318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.568318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.569037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.569283] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.761383] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.761596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.761643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.762166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.762166] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.762166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.762399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.762399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.762484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.762525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.762654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.762746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.762806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.762968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.763405] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.763405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.763405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.763405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.763583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.763583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.763660] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.072557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.073440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.073440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.073440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.073440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.073440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.073780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.073780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.073780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.073932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.073993] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 already deleted. [ 979.074127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.267508] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72471c75-08a5-45be-9362-d9463542469e: rpc.has_security_group_logging(os_id): False [ 979.269770] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.269770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.269770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.270054] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.270054] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.270225] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.270332] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.270545] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.270688] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.270908] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.271015] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.271127] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.271429] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.271761] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.271816] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.271943] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.289025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.289025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.289025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.289214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.289355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.289706] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.289836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.289918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.290102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.290205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.290405] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.290518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.290603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.290810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.290932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.291241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.291432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.291542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.291744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.291830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.291931] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 979.294069] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.294242] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.294421] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.294605] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-612" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.294888] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f133fca5-3a68-4b1d-961a-adf82d9ae631 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.295577] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.295760] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.296063] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.296213] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f133fca5-3a68-4b1d-961a-adf82d9ae631',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.333808] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 979.334066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.334227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.334445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.334629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.334884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.334884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.334988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.335026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.335128] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.356281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.356453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.356511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.356717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.356863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.369829] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 979.802022] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.802022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f133fca5-3a68-4b1d-961a-adf82d9ae631 not found, creating... [ 979.802022] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.802022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.802543] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.802543] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.802543] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.802543] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.802543] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.803080] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f133fca5-3a68-4b1d-961a-adf82d9ae631 is going to be created. [ 979.824024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.824602] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.825373] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.826061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.826061] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.826243] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.841112] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.342287] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.778162] env[69847]: INFO networking_nsxv3.common.synchronization [req-e7e75252-821e-4caf-97f8-36f688aad9e3 req-b89de50a-d93a-4851-9c48-3ce8d7bbea16 service nova] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_rules [ 980.778328] env[69847]: INFO networking_nsxv3.common.synchronization [req-e7e75252-821e-4caf-97f8-36f688aad9e3 req-b89de50a-d93a-4851-9c48-3ce8d7bbea16 service nova] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_members [ 980.778371] env[69847]: INFO networking_nsxv3.common.synchronization [req-e7e75252-821e-4caf-97f8-36f688aad9e3 req-b89de50a-d93a-4851-9c48-3ce8d7bbea16 service nova] Enqueued Resource ID: f133fca5-3a68-4b1d-961a-adf82d9ae631 with Priority: HIGHEST for action port [ 980.779397] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_rules [ 980.779397] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_members [ 980.779397] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f133fca5-3a68-4b1d-961a-adf82d9ae631 with Priority: HIGHEST for action port [ 980.780816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.781031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.781031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.781219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.781324] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.782369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.782369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.782369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.782527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.783029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.783029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.783029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.783029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.783029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.783247] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.787165] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f133fca5-3a68-4b1d-961a-adf82d9ae631 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.787314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.787382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.787551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.787625] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f133fca5-3a68-4b1d-961a-adf82d9ae631',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.847042] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.847172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.847245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.847458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.848346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.848346] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 980.880041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.880190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.880296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.880491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.880592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.889983] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 981.070015] env[69847]: INFO networking_nsxv3.common.synchronization [req-a9be48f7-d794-4ed7-b72e-17e638dbe642 req-5149cdb5-8ea3-4014-83e2-4eb7b5133591 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 981.070015] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 981.070166] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.070299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.070377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.070635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.070799] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.070895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.070953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.071113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.071192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.071305] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.289813] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.291191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.291191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.291580] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f133fca5-3a68-4b1d-961a-adf82d9ae631 with status ACTIVE [ 981.291728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.292026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.292026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.292137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.292223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.292528] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.292528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.292639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.292697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.292773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.292963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.296341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.296341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.297152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.297152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.297672] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f133fca5-3a68-4b1d-961a-adf82d9ae631 is going to be updated. [ 981.319295] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.319395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.319504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.319660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.320041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.322413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f133fca5-3a68-4b1d-961a-adf82d9ae631" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.383227] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 981.383539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.573236] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.678779] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.678779] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.678779] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.678984] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.679194] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.679393] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.679490] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.679715] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.679858] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.680091] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.680198] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.680309] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.680561] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.680696] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 981.680815] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.680948] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.708603] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.708603] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 981.708603] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.708903] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.709066] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-477d5322-2228-430b-8e88-9c052d1a071c taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.709273] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.709401] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.709758] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.710609] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('477d5322-2228-430b-8e88-9c052d1a071c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.792174] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.077247] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.213365] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.213742] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.213884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.214210] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.214369] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.214535] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 477d5322-2228-430b-8e88-9c052d1a071c not found, creating... [ 982.214817] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.214977] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.215137] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.215384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.215568] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.215892] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.216553] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.216641] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.216996] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.217402] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.217402] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 477d5322-2228-430b-8e88-9c052d1a071c is going to be created. [ 982.237289] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.237656] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.237878] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.238285] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.238644] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.238946] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.295094] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.295261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.295334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.295552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.295650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.295766] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 is going to be created. [ 982.326106] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.326271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.326342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.326552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.326708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.342020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c523ece5-b863-4da0-bab3-ae503f8fa633 in Status: UNINITIALIZED for 2s [ 982.580033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.580033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.580033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.580644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.580644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.580644] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 982.616249] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.616930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.616930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.616930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.616930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.627997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 982.903095] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 982.903304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.903584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.903776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.903986] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.904154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.904523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.904523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.904523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.904523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.904756] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.407982] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.411020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.411020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.411020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.411020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.411886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.411886] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.627076] env[69847]: INFO networking_nsxv3.common.synchronization [req-a9be48f7-d794-4ed7-b72e-17e638dbe642 req-f3e97c24-8dea-43ab-b475-bf3a3494588b service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 983.627076] env[69847]: INFO networking_nsxv3.common.synchronization [req-a9be48f7-d794-4ed7-b72e-17e638dbe642 req-f3e97c24-8dea-43ab-b475-bf3a3494588b service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 983.627076] env[69847]: INFO networking_nsxv3.common.synchronization [req-a9be48f7-d794-4ed7-b72e-17e638dbe642 req-f3e97c24-8dea-43ab-b475-bf3a3494588b service nova] Enqueued Resource ID: 477d5322-2228-430b-8e88-9c052d1a071c with Priority: HIGHEST for action port [ 983.627076] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 983.627076] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 983.627076] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477d5322-2228-430b-8e88-9c052d1a071c with Priority: HIGHEST for action port [ 983.628100] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.628249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.628321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.628531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.628618] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.630870] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.630976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.631233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-477d5322-2228-430b-8e88-9c052d1a071c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.631455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.631455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.631633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.631740] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('477d5322-2228-430b-8e88-9c052d1a071c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.637217] env[69847]: INFO networking_nsxv3.common.synchronization [None req-2d4470f6-ea17-461b-9fc5-066ac6d96f99 None None] Enqueued Resource ID: b19e9f50-ebd3-46ed-bf09-130a2d4c1299 with Priority: HIGHEST for action port [ 983.638420] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b19e9f50-ebd3-46ed-bf09-130a2d4c1299 with Priority: HIGHEST for action port [ 983.638684] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b19e9f50-ebd3-46ed-bf09-130a2d4c1299 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.638684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b19e9f50-ebd3-46ed-bf09-130a2d4c1299" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.638895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b19e9f50-ebd3-46ed-bf09-130a2d4c1299" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.639306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b19e9f50-ebd3-46ed-bf09-130a2d4c1299" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.639477] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b19e9f50-ebd3-46ed-bf09-130a2d4c1299',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.914192] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 983.934797] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.934971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.935061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.935413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.955931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.957323] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.957506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.957873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.957873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.957873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.958039] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.958141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.958205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.958358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.958434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.958610] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.958705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.958766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.958901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.958977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.959196] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 984.019227] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.019468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.019468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.019706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.019841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.030591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 984.137111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.137345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.137600] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 477d5322-2228-430b-8e88-9c052d1a071c with status ACTIVE [ 984.137997] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.138641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.138785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.139049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.139198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.143320] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.143320] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.143320] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 477d5322-2228-430b-8e88-9c052d1a071c is going to be updated. [ 984.143320] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b19e9f50-ebd3-46ed-bf09-130a2d4c1299 [ 984.143320] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.143320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.144000] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b19e9f50-ebd3-46ed-bf09-130a2d4c1299 already deleted. [ 984.144000] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b19e9f50-ebd3-46ed-bf09-130a2d4c1299" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.182639] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.183509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.183509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.183509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.183509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.183509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-477d5322-2228-430b-8e88-9c052d1a071c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.352252] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c523ece5-b863-4da0-bab3-ae503f8fa633 in Status: SUCCESS [ 984.352529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.352744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.353014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.353257] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.353429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.353504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.353677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.353796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.353888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.354040] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.637428] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 984.637428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.637733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.637916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.638104] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.639424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.639424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.639424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.639424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.639424] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.660058] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-b5e949b0-1032-49d4-b3f6-15e21777ce8a tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 984.660269] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 984.660713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.660948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.661072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.661370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.663688] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.663688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.663688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.663688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.663688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.663688] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.776756] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ca43d1f6-ba8c-4878-9e14-4acca8fc6f05 None None] Enqueued Resource ID: 2342548a-e88d-42b5-a250-31cdf345d361 with Priority: HIGHEST for action port [ 984.776756] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2342548a-e88d-42b5-a250-31cdf345d361 with Priority: HIGHEST for action port [ 984.776937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2342548a-e88d-42b5-a250-31cdf345d361 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.776937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2342548a-e88d-42b5-a250-31cdf345d361" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.777029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2342548a-e88d-42b5-a250-31cdf345d361" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.777286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2342548a-e88d-42b5-a250-31cdf345d361" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.777325] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2342548a-e88d-42b5-a250-31cdf345d361',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.857607] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.146967] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.168142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.170142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.170142] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee already deleted. [ 985.170142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.281123] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2342548a-e88d-42b5-a250-31cdf345d361 [ 985.282606] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.282606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.282606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.282606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.282606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.282606] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2342548a-e88d-42b5-a250-31cdf345d361 already deleted. [ 985.282606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2342548a-e88d-42b5-a250-31cdf345d361" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.361585] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c523ece5-b863-4da0-bab3-ae503f8fa633: rpc.has_security_group_logging(os_id): False [ 985.378944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.378944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.378944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.378944] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 is going to be created. [ 985.432069] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.432069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.432069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.432069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.432069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.440331] env[69847]: INFO networking_nsxv3.common.synchronization [req-a5d0c2c2-673f-48bf-9b01-56bfb4d52d7c req-19344ff5-de7d-4331-8600-3946cf3f4b37 tempest-VolumesAdminNegativeTest-613767114 tempest-VolumesAdminNegativeTest-613767114-project-member] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_members [ 985.441384] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGHEST for action security_group_members [ 985.441384] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.442123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.442123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.443032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.443032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.443032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.443032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.443032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.444605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.444605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.446531] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c523ece5-b863-4da0-bab3-ae503f8fa633 in Status: IN_PROGRESS for 2s [ 985.478032] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-7f1dcae4-b318-4109-b13e-e2806eb601a6 tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 985.478032] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 985.478032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.478032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.478032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.478032] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.648229] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.949701] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.949701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.949701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.949701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.976052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.976268] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.980029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.980029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.980029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.980029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.980029] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 is going to be updated. [ 985.986455] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.986644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.986745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.987021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.987145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.987391] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.987512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.988032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.988032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.988691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.988831] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee already deleted. [ 985.989059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.007959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.007959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.007959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.007959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.007959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.021931] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: IN_PROGRESS for 2s [ 986.045950] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 986.046282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.151026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.151026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.151257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.151376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.151494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.151608] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 986.168830] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-4d948a96-130b-43ba-ac7a-e3c5a97d94de tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 986.169443] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 986.169753] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.169910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.169969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.170207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.170387] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.170466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.170529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.172277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.172321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.172431] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.220803] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.220803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.220803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.220803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.220803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.229713] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 986.290096] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6a88904c-5b56-4aac-954f-bd6e14ab3474 None None] Enqueued Resource ID: 01e70ce1-92fa-4b19-a039-95bebaa5dae3 with Priority: HIGHEST for action port [ 986.290096] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01e70ce1-92fa-4b19-a039-95bebaa5dae3 with Priority: HIGHEST for action port [ 986.290096] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-01e70ce1-92fa-4b19-a039-95bebaa5dae3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.290096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01e70ce1-92fa-4b19-a039-95bebaa5dae3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.290096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01e70ce1-92fa-4b19-a039-95bebaa5dae3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.290377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01e70ce1-92fa-4b19-a039-95bebaa5dae3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.290447] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01e70ce1-92fa-4b19-a039-95bebaa5dae3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.642776] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e7d8719f-d45f-4826-ad7e-6679950f1a0e tempest-ServersTestManualDisk-785297740 tempest-ServersTestManualDisk-785297740-project-member] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_rules [ 986.644129] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_rules [ 986.644129] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.644129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.644129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.646148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.646355] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.674451] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.674759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.675549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.675549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.675549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.675549] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.675549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.675833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.675833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.675833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.675923] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee already deleted. [ 986.676011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.750980] env[69847]: INFO networking_nsxv3.common.synchronization [None req-63f0c635-d4eb-4680-9f7b-ae409be91000 tempest-ServersTestManualDisk-785297740 tempest-ServersTestManualDisk-785297740-project-member] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_rules [ 986.751832] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_rules [ 986.751902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.751957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.793673] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01e70ce1-92fa-4b19-a039-95bebaa5dae3 [ 986.793673] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.793673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.793673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.793673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.793673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.793673] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01e70ce1-92fa-4b19-a039-95bebaa5dae3 already deleted. [ 986.793673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01e70ce1-92fa-4b19-a039-95bebaa5dae3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.861725] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.861725] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.861725] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.861725] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.861941] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.861941] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.862047] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.862306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.862735] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.863050] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.863104] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.863223] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.863334] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.863518] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.863732] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.864184] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.885811] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.886551] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.887591] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.887911] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.889363] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.889563] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.889693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.890027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.890176] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d3b12a9-1e91-4f63-b031-5dd4b83659c0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.169812] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.169812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.169812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.169812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.170661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.170815] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 already deleted. [ 987.170953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.171422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.172236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.172333] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.239255] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c06c003-5ba2-47b2-a193-5c81245c35ff req-20928dff-0072-4b5a-8231-86a03194371c tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 987.239922] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 987.240204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.240957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.240957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.241414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.241609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.241722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.241789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.242014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.243739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.243739] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.356045] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e211ae00-a174-41d6-bed5-4fcaba860598 None None] Enqueued Resource ID: 86939b2b-5a30-4ed4-922d-f525103a75d9 with Priority: HIGHEST for action port [ 987.356045] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86939b2b-5a30-4ed4-922d-f525103a75d9 with Priority: HIGHEST for action port [ 987.360510] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-86939b2b-5a30-4ed4-922d-f525103a75d9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.360510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86939b2b-5a30-4ed4-922d-f525103a75d9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.360510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86939b2b-5a30-4ed4-922d-f525103a75d9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.360510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86939b2b-5a30-4ed4-922d-f525103a75d9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.360510] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86939b2b-5a30-4ed4-922d-f525103a75d9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.392301] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.392554] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.392679] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.392968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.393129] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.393538] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 8d3b12a9-1e91-4f63-b031-5dd4b83659c0 not found, creating... [ 987.393875] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.394103] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.394266] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.394486] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.394712] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.397084] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.397084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.397084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.397084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.397084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.397084] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 8d3b12a9-1e91-4f63-b031-5dd4b83659c0 is going to be created. [ 987.417695] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.420276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.420276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.420276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.420276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.420276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.461085] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c523ece5-b863-4da0-bab3-ae503f8fa633 in Status: SUCCESS [ 987.461085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.513525] env[69847]: INFO networking_nsxv3.common.synchronization [req-d2d28595-c4ff-4d3c-9661-3669b5137323 req-e7bc7a9c-cc29-444d-b3a7-02471a354625 tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 987.513525] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 987.513525] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.514103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.516703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.516703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.516703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.516703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.516703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.516703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.516703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.516703] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.692883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.694289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.694289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.694289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.694289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.694289] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 already deleted. [ 987.694289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.745437] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.865564] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86939b2b-5a30-4ed4-922d-f525103a75d9 [ 987.865883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.866049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.866123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.866671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.866671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.866671] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86939b2b-5a30-4ed4-922d-f525103a75d9 already deleted. [ 987.866671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86939b2b-5a30-4ed4-922d-f525103a75d9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.868503] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.868783] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.868921] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.869316] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.869605] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.869808] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.869968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.870242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.870429] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.870769] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.870972] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.871187] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.871437] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.871677] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 987.871753] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.871925] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.890272] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.890607] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 987.891532] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.891532] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.891797] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.892150] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.892399] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.892788] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.893019] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbc3fa1-c428-4dd0-972a-51b266c6b4fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.019871] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.030994] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 in Status: SUCCESS [ 988.031261] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 deletion is rescheduled due to dependency. [ 988.031329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.045824] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6189aa2f-c18d-4e01-8710-844f06af85f0 None None] Enqueued Resource ID: 38c8d354-e857-44c6-946f-2f206ffb6915 with Priority: HIGHEST for action port [ 988.046424] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38c8d354-e857-44c6-946f-2f206ffb6915 with Priority: HIGHEST for action port [ 988.046950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-38c8d354-e857-44c6-946f-2f206ffb6915 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.047096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38c8d354-e857-44c6-946f-2f206ffb6915" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.047267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38c8d354-e857-44c6-946f-2f206ffb6915" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.047489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38c8d354-e857-44c6-946f-2f206ffb6915" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.047605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38c8d354-e857-44c6-946f-2f206ffb6915',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.239966] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 988.240662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.240662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.240974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.242871] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.242871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.242871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.242871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.242871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.242871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.242871] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.252902] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.396432] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.397411] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.397633] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.397955] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.398124] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.398809] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 7fbc3fa1-c428-4dd0-972a-51b266c6b4fd not found, creating... [ 988.398809] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.398809] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.398997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.402254] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.402426] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.402872] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.402981] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.403109] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.403340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.403501] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.403658] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 7fbc3fa1-c428-4dd0-972a-51b266c6b4fd is going to be created. [ 988.426904] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.427197] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.427593] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.427673] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.427882] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.428141] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.452528] env[69847]: INFO networking_nsxv3.common.synchronization [req-4ee7e013-baa7-460a-901b-3502f8ddb363 req-49769a1b-d477-42d6-ab26-052b3944be6f tempest-MultipleCreateTestJSON-1984531437 tempest-MultipleCreateTestJSON-1984531437-project-member] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 988.453871] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGHEST for action security_group_members [ 988.454303] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.454460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.525051] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.551815] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38c8d354-e857-44c6-946f-2f206ffb6915 [ 988.551815] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.551815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.551815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.552036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.552036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.552106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38c8d354-e857-44c6-946f-2f206ffb6915 already deleted. [ 988.552139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38c8d354-e857-44c6-946f-2f206ffb6915" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.746100] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.746100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.746100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.748512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.748683] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.748825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.748896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.749105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.749198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.749280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.749448] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.749550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.750165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.750337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.750517] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.750640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.750733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.750920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.751024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.751117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.751423] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.758301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.758463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.758544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.758711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.758814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.758909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 988.766377] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-d34769f4-b476-44cb-9b33-f931364b18ba service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 988.766566] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-d34769f4-b476-44cb-9b33-f931364b18ba service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 988.766708] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-d34769f4-b476-44cb-9b33-f931364b18ba service nova] Enqueued Resource ID: 8d3b12a9-1e91-4f63-b031-5dd4b83659c0 with Priority: HIGHEST for action port [ 988.768442] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 988.769400] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 988.769400] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3b12a9-1e91-4f63-b031-5dd4b83659c0 with Priority: HIGHEST for action port [ 988.769664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.769664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.769764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.770696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.770696] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.771476] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.771476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.771476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.771743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.771869] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.771977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.772110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.772227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.773261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.773261] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.773715] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.773827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.773894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.774059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.774136] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d3b12a9-1e91-4f63-b031-5dd4b83659c0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.789156] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.789368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.789368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.789608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.789853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.803238] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 989.025274] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.025418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.025484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.025697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.025805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.025903] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 989.050813] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.051011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.051107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.051346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.051548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.060415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 989.253566] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b495386a-9f65-4bd6-a72b-2cc4c5b333fe: rpc.has_security_group_logging(os_id): False [ 989.271051] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.271365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.271449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.271662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.275265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.275406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.276703] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d3b12a9-1e91-4f63-b031-5dd4b83659c0 with status ACTIVE [ 989.276878] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.276989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.277068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.277255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.277341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.277512] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.277604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.277663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.277805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.277877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.278062] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.278156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.278216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.278352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.278421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.278499] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d3b12a9-1e91-4f63-b031-5dd4b83659c0 is going to be updated. [ 989.279693] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.289127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.289560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.289560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.289560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.289803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.289857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.290040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.290150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.290206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.290961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.290961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.290961] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.290961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.290961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.290961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.291372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.291372] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 989.299846] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.300089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.300089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.300298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.300432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.300585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d3b12a9-1e91-4f63-b031-5dd4b83659c0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.316383] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c06c003-5ba2-47b2-a193-5c81245c35ff req-2da25de6-5c36-43cc-b007-02d8e57e49cd service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 989.316383] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c06c003-5ba2-47b2-a193-5c81245c35ff req-2da25de6-5c36-43cc-b007-02d8e57e49cd service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 989.316383] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c06c003-5ba2-47b2-a193-5c81245c35ff req-2da25de6-5c36-43cc-b007-02d8e57e49cd service nova] Enqueued Resource ID: 7fbc3fa1-c428-4dd0-972a-51b266c6b4fd with Priority: HIGHEST for action port [ 989.316497] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 989.316942] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 989.316942] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fbc3fa1-c428-4dd0-972a-51b266c6b4fd with Priority: HIGHEST for action port [ 989.317094] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.317464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.317464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.317578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.317611] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.320033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.320033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.320254] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.320613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.320613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.320613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.320765] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbc3fa1-c428-4dd0-972a-51b266c6b4fd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.380241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.380241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.380241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.380241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.380241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.390793] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 989.673777] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-131 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.673777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-131" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.673777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-131" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.674632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-131" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.675109] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.677611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.678474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.678474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.678624] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.678884] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.679022] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.679139] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.679249] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.679373] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.679491] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.679631] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.699938] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.699938] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.699938] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.699938] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-131" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.699938] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-c7cf733b-0f81-41a1-86dc-5b096c65c90e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.699938] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.699938] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.699938] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.699938] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7cf733b-0f81-41a1-86dc-5b096c65c90e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.784034] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.823657] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.823893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.824071] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fbc3fa1-c428-4dd0-972a-51b266c6b4fd with status ACTIVE [ 989.824294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.824467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.824551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.824813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.824932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.825149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.825271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.825363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.825573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.825687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.825969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.826122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.826225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.826444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.826645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.826696] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fbc3fa1-c428-4dd0-972a-51b266c6b4fd is going to be updated. [ 989.850139] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.850139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.850139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.850139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.850139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.850139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fbc3fa1-c428-4dd0-972a-51b266c6b4fd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.206856] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.207106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.207242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.207528] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.207687] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.207843] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port c7cf733b-0f81-41a1-86dc-5b096c65c90e not found, creating... [ 990.208154] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.208324] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.208443] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.208697] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.208844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.209166] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.209606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.209606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.209762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.209808] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.212056] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: c7cf733b-0f81-41a1-86dc-5b096c65c90e is going to be created. [ 990.234023] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.234023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.234023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.234023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.234023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.234023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.281203] env[69847]: INFO networking_nsxv3.common.synchronization [None req-5f7dbc8d-3790-4349-93d4-98d2677f7a3f None None] Enqueued Resource ID: 96710e74-3f63-40a6-a1d5-27fc6bf9cff5 with Priority: HIGHEST for action port [ 990.281486] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96710e74-3f63-40a6-a1d5-27fc6bf9cff5 with Priority: HIGHEST for action port [ 990.282309] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-96710e74-3f63-40a6-a1d5-27fc6bf9cff5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.282309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96710e74-3f63-40a6-a1d5-27fc6bf9cff5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.282309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96710e74-3f63-40a6-a1d5-27fc6bf9cff5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.282501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96710e74-3f63-40a6-a1d5-27fc6bf9cff5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.282588] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96710e74-3f63-40a6-a1d5-27fc6bf9cff5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.287636] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.288076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.288076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.288076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.288213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.288213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be created. [ 990.318114] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.318114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.318114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.318114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.318114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.327724] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: UNINITIALIZED for 2s [ 990.353299] env[69847]: INFO networking_nsxv3.common.synchronization [req-a4b92444-c7e5-4484-b3f0-b6ca78c05bc7 req-60af0315-5a96-45a1-8a69-9be17c56c148 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 990.354011] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 990.354399] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.354544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.354544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.354767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.354929] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.355632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.355632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.356390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.356390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.356390] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.787531] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96710e74-3f63-40a6-a1d5-27fc6bf9cff5 [ 990.787917] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.788148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.788275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.788630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.788800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.788968] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96710e74-3f63-40a6-a1d5-27fc6bf9cff5 already deleted. [ 990.789125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96710e74-3f63-40a6-a1d5-27fc6bf9cff5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.818019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.818019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.818019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.818019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.858404] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.073174] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 991.073455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.073680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.073951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.074251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.074356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.074482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.074932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.074932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.074932] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.322082] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.365744] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.412029] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 991.412029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.519606] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-74089ef5-15ce-442e-9e52-44371b73bc99 service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 991.519826] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-74089ef5-15ce-442e-9e52-44371b73bc99 service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 991.519977] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-74089ef5-15ce-442e-9e52-44371b73bc99 service nova] Enqueued Resource ID: c7cf733b-0f81-41a1-86dc-5b096c65c90e with Priority: HIGHEST for action port [ 991.520608] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 991.521265] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 991.522436] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7cf733b-0f81-41a1-86dc-5b096c65c90e with Priority: HIGHEST for action port [ 991.522988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.523151] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.523483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.524152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.525705] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7cf733b-0f81-41a1-86dc-5b096c65c90e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.526406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.527260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.527260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.527260] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7cf733b-0f81-41a1-86dc-5b096c65c90e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.577848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.578134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.578134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.578352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.578447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.578642] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.578769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.578822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.579041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.579437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.579437] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be updated. [ 991.640010] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.640220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.640220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.640367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.640531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.653707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: IN_PROGRESS for 2s [ 991.827758] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.870768] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.870768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.870768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.870768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.870768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.870768] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 991.902388] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.902388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.902388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.902388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.902388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.910896] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 992.032367] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7cf733b-0f81-41a1-86dc-5b096c65c90e with status ACTIVE [ 992.033276] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.033437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.033547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.033739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.033826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.034031] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.034129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.034193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.034344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.034414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.034617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.034710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.035905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.036134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.036245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.036347] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7cf733b-0f81-41a1-86dc-5b096c65c90e is going to be updated. [ 992.061905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.061905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.061905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.061905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.061905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.063956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7cf733b-0f81-41a1-86dc-5b096c65c90e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.330351] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.330591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.330706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.331009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.331160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.331304] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 992.343543] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.347164] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.347164] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.347164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.347790] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.347790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.347790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.347953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.348531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.348712] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.361179] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.361179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.361179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.361179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.361179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.369280] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 992.851879] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.853834] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.853834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.345274] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.345651] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.345651] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.345852] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.346701] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.346701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.346701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.346701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.348298] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.348298] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.348298] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.348298] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.348298] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.348298] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.348298] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.348298] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.353972] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.367613] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.367795] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.367936] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.368134] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-154" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.368446] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-b6551672-7f1b-4585-9c64-f971e3490082 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.368620] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.368742] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.369089] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.369706] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6551672-7f1b-4585-9c64-f971e3490082',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.663106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72471c75-08a5-45be-9362-d9463542469e in Status: SUCCESS [ 993.663295] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72471c75-08a5-45be-9362-d9463542469e deletion is rescheduled due to dependency. [ 993.663416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.856547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.856840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.856840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.857096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.857194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.857298] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 993.872072] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.872511] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.872767] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.873170] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.873402] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.873791] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port b6551672-7f1b-4585-9c64-f971e3490082 not found, creating... [ 993.874182] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.874431] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.874810] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.875191] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.875378] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.875738] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.875929] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.876067] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.876290] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.876429] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.876607] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: b6551672-7f1b-4585-9c64-f971e3490082 is going to be created. [ 993.890536] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.891014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.891204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.891516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.892092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.897929] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.898283] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.898536] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.898845] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.899201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.899587] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.901513] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 993.943924] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 993.944244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.380446] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 994.381718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.381718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.381718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.381718] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.381994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.381994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.382109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.382202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.382286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.382380] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.821020] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cdece8-69ba-4869-9f37-1fce74383b9f req-982f36c0-aa3f-4fb0-8f43-4d9b4c6a934b tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 994.821559] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 994.821875] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.821999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.822586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.823184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.823373] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.823756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.823837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.824131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.824131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.824227] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.884901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.885200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.885200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.885283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.885447] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.885663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.885663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.885756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.885869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.885965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.886127] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.886221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.886280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.886420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.886554] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.886644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.886703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.886838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.886910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.887104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.887104] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.235453] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-03d62ecf-b63f-4017-a62c-d3b517e5b921 service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 995.236060] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-03d62ecf-b63f-4017-a62c-d3b517e5b921 service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 995.236060] env[69847]: INFO networking_nsxv3.common.synchronization [req-38ace32d-ba6b-4a84-b448-4d4d559c11f9 req-03d62ecf-b63f-4017-a62c-d3b517e5b921 service nova] Enqueued Resource ID: b6551672-7f1b-4585-9c64-f971e3490082 with Priority: HIGHEST for action port [ 995.236060] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 995.236223] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 995.236256] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6551672-7f1b-4585-9c64-f971e3490082 with Priority: HIGHEST for action port [ 995.238920] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.238920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.238920] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.239138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.239177] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6551672-7f1b-4585-9c64-f971e3490082 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.239323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.239354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.239634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.239695] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6551672-7f1b-4585-9c64-f971e3490082',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.328958] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.328958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.328958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.328958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.328958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.328958] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.329453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.329453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.329453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.329453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.329453] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 already deleted. [ 995.329634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.391158] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 320d8032-7c7f-4adf-9aaa-d27d0fb2efff: rpc.has_security_group_logging(os_id): False [ 995.411938] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.412138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.412182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.413038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.413038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.413038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.413038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.413038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.413038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.413879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.414682] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.414819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.414886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.415072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.415158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.415366] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.415466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.415530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.415680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.415758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.415936] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 995.480169] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.480169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.480169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.480169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.480169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.497776] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 995.742590] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6551672-7f1b-4585-9c64-f971e3490082 with status ACTIVE [ 995.742868] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.743017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.743094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.743377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.743540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.743749] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.743855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.743919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.744108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.744207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.744452] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.744559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.744623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.744773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.744861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.744960] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6551672-7f1b-4585-9c64-f971e3490082 is going to be updated. [ 995.768736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.768935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.768997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.769197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.769352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.769523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6551672-7f1b-4585-9c64-f971e3490082" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.915076] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 995.915591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.916095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.916293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.916527] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.916682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.916788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.916981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.917105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.917220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.917420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.917538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.917625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.917803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.918025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.918137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.918228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.918405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.918517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.918609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.919052] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.919658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.919865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.919998] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.920124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.920197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.920345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.920423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.920513] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.149228] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.150214] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.150214] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.150214] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.150214] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.150657] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.154031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.154031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.154031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.154031] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.154031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.154031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.154031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.154031] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.154031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.154031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.177246] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.178025] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.178125] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.179314] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.180087] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-caab9659-791d-4fd9-bc40-03322b1cbbf1 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.180904] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.181081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.185557] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.185557] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caab9659-791d-4fd9-bc40-03322b1cbbf1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.423997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08043f9f-80db-4591-bf09-4b14d00f17ee: rpc.has_security_group_logging(os_id): False [ 996.425483] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.448072] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.448150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.448243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.448638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.448638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.450769] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.450769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.450769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.450769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.450769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.450769] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.453288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.453288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.453460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.453620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.453916] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.454212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.457875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.458189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.458312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.458460] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be created. [ 996.527037] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.527037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.527037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.527037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.527037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.539062] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 996.690232] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.690232] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port caab9659-791d-4fd9-bc40-03322b1cbbf1 not found, creating... [ 996.690232] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.690232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.690887] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.690887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.690887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.690887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.690887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.690887] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: caab9659-791d-4fd9-bc40-03322b1cbbf1 is going to be created. [ 996.711303] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.711671] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.711843] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.712167] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.712408] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.712646] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.929086] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.437656] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.437939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.438028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.438254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.438325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.438422] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 997.468332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.468332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.468332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.468332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.468332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.477121] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 997.516569] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 997.516569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.676521] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cdece8-69ba-4869-9f37-1fce74383b9f req-57f4ea7d-1f08-4d1a-a40e-8960a038c804 service nova] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_rules [ 997.676521] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cdece8-69ba-4869-9f37-1fce74383b9f req-57f4ea7d-1f08-4d1a-a40e-8960a038c804 service nova] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 997.676521] env[69847]: INFO networking_nsxv3.common.synchronization [req-72cdece8-69ba-4869-9f37-1fce74383b9f req-57f4ea7d-1f08-4d1a-a40e-8960a038c804 service nova] Enqueued Resource ID: caab9659-791d-4fd9-bc40-03322b1cbbf1 with Priority: HIGHEST for action port [ 997.677248] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_rules [ 997.680716] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 997.680716] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caab9659-791d-4fd9-bc40-03322b1cbbf1 with Priority: HIGHEST for action port [ 997.680716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.680716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.680716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.680716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.680716] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.680716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.680716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.680716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.682435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.683431] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.683431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.683861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.684194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.685127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.685127] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.685950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-caab9659-791d-4fd9-bc40-03322b1cbbf1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.686213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.686357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.686982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.687107] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('caab9659-791d-4fd9-bc40-03322b1cbbf1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.189335] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.189743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.189743] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.192477] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port caab9659-791d-4fd9-bc40-03322b1cbbf1 with status ACTIVE [ 998.193033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.193033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.193033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.193033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.193223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.193323] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.193368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.193402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.194212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.194212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.194212] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.194212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.194212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.194212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.194212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.194468] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: caab9659-791d-4fd9-bc40-03322b1cbbf1 is going to be updated. [ 998.222352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.222451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.222612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.222696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.222837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.223182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-caab9659-791d-4fd9-bc40-03322b1cbbf1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.554108] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 998.554343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.554532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.554758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.554851] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.691999] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.058812] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.058948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.194689] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.195042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.195042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.195279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.195279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.195412] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be created. [ 999.218628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.218746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.218920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.219134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.219361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.231972] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: UNINITIALIZED for 2s [ 999.487489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 999.488373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.488373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.488373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.488373] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.489454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.489454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.489454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.489454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.489454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.489454] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.994059] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.994354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.994354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.994524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.994733] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.994850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.995032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.995102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.995212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.995288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.995441] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.995565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.995626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.995777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.995918] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.996039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.996112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.996233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.996314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.996410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.996592] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.500479] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08043f9f-80db-4591-bf09-4b14d00f17ee: rpc.has_security_group_logging(os_id): False [ 1000.516602] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.516753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.516819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.517038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.517125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.517337] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.517461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.517522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.517684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.517757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.517946] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.519647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.519647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.519647] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1000.577019] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.577176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.577248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.577462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.577607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.588041] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1001.242511] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: SUCCESS [ 1001.242588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.242751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.243241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.243241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.243433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.243433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.243495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.243780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.243780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.243780] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.299253] env[69847]: INFO networking_nsxv3.common.synchronization [None req-66c62353-0a4d-4fca-a900-12d22288dad3 None None] Enqueued Resource ID: 41d250dc-c528-49d1-8630-9e170fb00bdf with Priority: HIGHEST for action port [ 1001.299872] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41d250dc-c528-49d1-8630-9e170fb00bdf with Priority: HIGHEST for action port [ 1001.300298] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-41d250dc-c528-49d1-8630-9e170fb00bdf taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.300422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41d250dc-c528-49d1-8630-9e170fb00bdf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.300422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41d250dc-c528-49d1-8630-9e170fb00bdf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.300988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41d250dc-c528-49d1-8630-9e170fb00bdf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.300988] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41d250dc-c528-49d1-8630-9e170fb00bdf',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.747470] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.747845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.747845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.747999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.748223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.748325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.748401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.748602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.749216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.749216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.749216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.749400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.749400] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.749483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.749560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.749678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.749750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.749923] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.804978] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41d250dc-c528-49d1-8630-9e170fb00bdf [ 1001.804978] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.804978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.804978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.804978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.804978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.804978] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41d250dc-c528-49d1-8630-9e170fb00bdf already deleted. [ 1001.804978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41d250dc-c528-49d1-8630-9e170fb00bdf" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.256058] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e41d6c35-289a-46b1-9113-0dea949327e3: rpc.has_security_group_logging(os_id): False [ 1002.275697] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.275858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.275921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.276401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.277345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.277345] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.277345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.277345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.277345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.277345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.277614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.277614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.277699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.277825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.277899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.278289] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.278406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.278469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.278614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.278690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.278774] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be created. [ 1002.332894] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.336017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.336017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.336017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.336017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.349245] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: IN_PROGRESS for 2s [ 1002.356139] env[69847]: INFO networking_nsxv3.common.synchronization [req-6293c041-4dd8-43a8-9b97-a54c069b0f79 req-74d0523c-966a-411e-9fec-8d01addbaa64 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1002.356139] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1002.356139] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.356139] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.356139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.356139] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.600925] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1002.600925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.601783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.601783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.601783] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.860825] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.104832] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.105843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.105843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.105843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.105843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.106129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.106129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.107036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.107036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.107118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.107227] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.279023] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c0903679-2e9f-4ca6-9a15-186b36af333c None None] Enqueued Resource ID: cb23619b-359a-47c1-a83d-ec4684c534b0 with Priority: HIGHEST for action port [ 1003.279023] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb23619b-359a-47c1-a83d-ec4684c534b0 with Priority: HIGHEST for action port [ 1003.279023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb23619b-359a-47c1-a83d-ec4684c534b0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.279023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb23619b-359a-47c1-a83d-ec4684c534b0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.279285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb23619b-359a-47c1-a83d-ec4684c534b0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.279622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb23619b-359a-47c1-a83d-ec4684c534b0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.279799] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb23619b-359a-47c1-a83d-ec4684c534b0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.363170] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.392240] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4982bf67-80a3-4cf2-9d78-b9c026636e32 tempest-ServersV294TestFqdnHostnames-2038459689 tempest-ServersV294TestFqdnHostnames-2038459689-project-member] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_rules [ 1003.392517] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_rules [ 1003.392986] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.392986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.393876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.395801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.395801] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.610584] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.610945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.610945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.611161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.611344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.611417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.611485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.611661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.611802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.611859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.612017] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.612112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.612177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.612347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.612496] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.612604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.612668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.612809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.612883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.612996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.614328] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.616960] env[69847]: INFO networking_nsxv3.common.synchronization [None req-3a148bd7-572d-410b-9d2c-faf031c0f4cd tempest-ServersV294TestFqdnHostnames-2038459689 tempest-ServersV294TestFqdnHostnames-2038459689-project-member] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_rules [ 1003.617287] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_rules [ 1003.617810] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.617904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.655481] env[69847]: INFO networking_nsxv3.common.synchronization [req-052ff700-6c58-4ef5-b63e-5b48dde9cd0f req-10ea8516-e813-44fd-8e14-b870a1c85cf2 tempest-ServersTestManualDisk-785297740 tempest-ServersTestManualDisk-785297740-project-member] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_members [ 1003.656098] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_members [ 1003.656493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.656664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.656768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.657064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.657280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.657639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.657881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.658138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.658290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.658428] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.781704] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb23619b-359a-47c1-a83d-ec4684c534b0 [ 1003.783158] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.783326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.783390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.783764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.783764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.783907] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb23619b-359a-47c1-a83d-ec4684c534b0 already deleted. [ 1003.783907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb23619b-359a-47c1-a83d-ec4684c534b0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.865883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.868721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.868721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.868721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.868721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.868721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 1003.898937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.898937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.898937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.898937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.898937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.917105] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 1003.934704] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.934704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.934704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.934924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.934924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.934993] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb already deleted. [ 1003.935043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.935610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.935713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.935789] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.983832] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-506 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.984051] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-506" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.984401] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-506" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.984853] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-506" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.985211] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.985388] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.985514] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.985743] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.986062] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.986388] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.986603] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.986734] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.986856] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.986979] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.987145] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.987295] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.009051] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.009556] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.010061] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.011040] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-506" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.011040] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-e582b7bd-f782-4130-a166-a88fba3d605b taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.011251] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.011473] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.011920] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.012217] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e582b7bd-f782-4130-a166-a88fba3d605b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.118216] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08043f9f-80db-4591-bf09-4b14d00f17ee: rpc.has_security_group_logging(os_id): False [ 1004.135068] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.135345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.135345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.136017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.136017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.136017] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.136017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.136263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.136851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.136952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.137262] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.137262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.137407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.137500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.138213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.138443] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.138533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.138591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.138727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.138966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.140034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1004.162112] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.162112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.162112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.162112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.162112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.162112] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.162112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.162739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.162739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.162739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.162911] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 already deleted. [ 1004.163427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.219368] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.219368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.219368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.219368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.219368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.232100] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1004.378589] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: SUCCESS [ 1004.378827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.459476] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.460375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.460503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.460734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.460828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.460927] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb already deleted. [ 1004.461012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.521036] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.521036] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port e582b7bd-f782-4130-a166-a88fba3d605b not found, creating... [ 1004.521036] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.521036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.521704] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.521704] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.521704] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.522722] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.522810] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.522961] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: e582b7bd-f782-4130-a166-a88fba3d605b is going to be created. [ 1004.547607] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.547839] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.547839] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.548227] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.548339] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.548503] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.436752] env[69847]: INFO networking_nsxv3.common.synchronization [req-052ff700-6c58-4ef5-b63e-5b48dde9cd0f req-bcc6e96f-39bb-4428-abc7-ace6382f4b01 service nova] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_rules [ 1005.437018] env[69847]: INFO networking_nsxv3.common.synchronization [req-052ff700-6c58-4ef5-b63e-5b48dde9cd0f req-bcc6e96f-39bb-4428-abc7-ace6382f4b01 service nova] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_members [ 1005.437069] env[69847]: INFO networking_nsxv3.common.synchronization [req-052ff700-6c58-4ef5-b63e-5b48dde9cd0f req-bcc6e96f-39bb-4428-abc7-ace6382f4b01 service nova] Enqueued Resource ID: e582b7bd-f782-4130-a166-a88fba3d605b with Priority: HIGHEST for action port [ 1005.437295] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_rules [ 1005.437553] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_members [ 1005.437553] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e582b7bd-f782-4130-a166-a88fba3d605b with Priority: HIGHEST for action port [ 1005.440724] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.440908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.441031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.441369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.441622] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.444537] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.446978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.447096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.450058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.450058] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.450058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e582b7bd-f782-4130-a166-a88fba3d605b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.450058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.450568] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e582b7bd-f782-4130-a166-a88fba3d605b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.741018] env[69847]: INFO networking_nsxv3.common.synchronization [None req-16707b93-1c06-4a8a-99b4-0505873cb5ad None None] Enqueued Resource ID: 93c56820-6fba-4741-ad1a-68b7ac4bf3b4 with Priority: HIGHEST for action port [ 1005.741018] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93c56820-6fba-4741-ad1a-68b7ac4bf3b4 with Priority: HIGHEST for action port [ 1005.741199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-93c56820-6fba-4741-ad1a-68b7ac4bf3b4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.741324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93c56820-6fba-4741-ad1a-68b7ac4bf3b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.741390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93c56820-6fba-4741-ad1a-68b7ac4bf3b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.741686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93c56820-6fba-4741-ad1a-68b7ac4bf3b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.741772] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c56820-6fba-4741-ad1a-68b7ac4bf3b4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.802265] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c6e7da53-4777-4e75-ad54-3b1466a51bdc None None] Enqueued Resource ID: fb123b1a-fb2d-4c69-aba0-8560e49e94a2 with Priority: HIGHEST for action port [ 1005.802265] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb123b1a-fb2d-4c69-aba0-8560e49e94a2 with Priority: HIGHEST for action port [ 1005.802265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb123b1a-fb2d-4c69-aba0-8560e49e94a2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.802265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb123b1a-fb2d-4c69-aba0-8560e49e94a2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.802265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb123b1a-fb2d-4c69-aba0-8560e49e94a2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.802656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb123b1a-fb2d-4c69-aba0-8560e49e94a2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.802695] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb123b1a-fb2d-4c69-aba0-8560e49e94a2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.926376] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 1005.926592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.956023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.956023] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.956023] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e582b7bd-f782-4130-a166-a88fba3d605b with status ACTIVE [ 1005.956023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.956023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.956023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.956533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.956533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.956533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.956533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.956533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.958974] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e582b7bd-f782-4130-a166-a88fba3d605b is going to be updated. [ 1005.975453] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.975453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.975453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.975453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.975453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.975453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e582b7bd-f782-4130-a166-a88fba3d605b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.244606] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93c56820-6fba-4741-ad1a-68b7ac4bf3b4 [ 1006.244842] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.244966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.245040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.245283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.245374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.245468] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93c56820-6fba-4741-ad1a-68b7ac4bf3b4 already deleted. [ 1006.245550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93c56820-6fba-4741-ad1a-68b7ac4bf3b4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.249401] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1006.249401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.306153] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb123b1a-fb2d-4c69-aba0-8560e49e94a2 [ 1006.306433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.306504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.306946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.307438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.307542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.307647] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb123b1a-fb2d-4c69-aba0-8560e49e94a2 already deleted. [ 1006.307885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb123b1a-fb2d-4c69-aba0-8560e49e94a2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.458934] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.743993] env[69847]: INFO networking_nsxv3.common.synchronization [req-3919dec2-a06b-4796-a56f-d516924f6ab5 req-f8adcf7f-7f4d-4418-973f-b6fee6d206e8 tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1006.744505] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1006.744852] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.744976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.748118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.748857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.748857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.748857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.748857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.748857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.749641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.749641] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.961810] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.961980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.962522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.962522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.963889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.963889] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 is going to be created. [ 1006.988569] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.988758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.988790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.988996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.989266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.999149] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 in Status: UNINITIALIZED for 2s [ 1007.251849] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.284534] env[69847]: INFO networking_nsxv3.common.synchronization [req-3919dec2-a06b-4796-a56f-d516924f6ab5 req-ac91e110-6ecc-4a09-86e0-d4ed4a5c0515 tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1007.285596] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1007.286285] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.286285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.332841] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b882fcc6-b0bb-49e9-ba02-fbf3ffa468c4 tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1007.333442] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1007.333813] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.333938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.334013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.335082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.335227] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.477923] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9be21f6a-3e6b-4276-8b39-e21d7f2c4696 tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1007.479643] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1007.480382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.480382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.557320] env[69847]: INFO networking_nsxv3.common.synchronization [req-3919dec2-a06b-4796-a56f-d516924f6ab5 req-14d73768-4fc7-4638-81fe-c849c9dbf42a tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1007.557584] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1007.557838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.557972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.756802] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.857120] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.857263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.857337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.857560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.857667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.857773] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 already deleted. [ 1007.857937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.858018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.858196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.858279] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.021829] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c5d7e07-a78e-4ffe-a977-d9786660844d req-89a5f9ed-911a-4870-9310-dcd9c7417c00 tempest-ServersNegativeTestMultiTenantJSON-1819460926 tempest-ServersNegativeTestMultiTenantJSON-1819460926-project-member] Enqueued Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_members [ 1008.025021] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_members [ 1008.025021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.025021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.025021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.025021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.115953] env[69847]: INFO networking_nsxv3.common.synchronization [None req-77bb8560-3a90-4227-ba5b-1091b6816826 None None] Enqueued Resource ID: ddd77f08-1925-4457-8807-5a07d37563c1 with Priority: HIGHEST for action port [ 1008.116763] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd77f08-1925-4457-8807-5a07d37563c1 with Priority: HIGHEST for action port [ 1008.122202] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd77f08-1925-4457-8807-5a07d37563c1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.122202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd77f08-1925-4457-8807-5a07d37563c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.122202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd77f08-1925-4457-8807-5a07d37563c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.122202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd77f08-1925-4457-8807-5a07d37563c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.122202] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd77f08-1925-4457-8807-5a07d37563c1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.259713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.259713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.259713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.259873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.259873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.259935] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1008.287123] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.287317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.287411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.287646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.287868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.296237] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1008.387944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.388089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.388134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.388317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.388500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.388721] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 already deleted. [ 1008.388845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.480497] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6afd6e35-7f41-4d48-8999-81077f82b06a None None] Enqueued Resource ID: 6de5dcd6-f74c-430d-ade8-fdb9b51862bd with Priority: HIGHEST for action port [ 1008.480497] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de5dcd6-f74c-430d-ade8-fdb9b51862bd with Priority: HIGHEST for action port [ 1008.481324] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de5dcd6-f74c-430d-ade8-fdb9b51862bd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.481447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de5dcd6-f74c-430d-ade8-fdb9b51862bd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.481507] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de5dcd6-f74c-430d-ade8-fdb9b51862bd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.481791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de5dcd6-f74c-430d-ade8-fdb9b51862bd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.481888] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de5dcd6-f74c-430d-ade8-fdb9b51862bd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.526944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.527116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.527182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.527392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.527481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.527667] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.528268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.528388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.528553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.528636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.528731] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 already deleted. [ 1008.528827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.530872] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.531180] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-460" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.532204] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-460" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.532204] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-460" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.532204] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.532204] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.532411] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.532476] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.532634] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.532801] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.532933] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.533166] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.533166] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.533285] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.533433] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.533548] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.557516] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.557728] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.557881] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.558077] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-460" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.558439] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-fc2604d7-5708-4d3b-98c7-c9649a7a5439 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.558645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.558780] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.559568] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.559568] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc2604d7-5708-4d3b-98c7-c9649a7a5439',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.625278] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddd77f08-1925-4457-8807-5a07d37563c1 [ 1008.625278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.625278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.625278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.625278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.625278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.625278] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddd77f08-1925-4457-8807-5a07d37563c1 already deleted. [ 1008.625278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd77f08-1925-4457-8807-5a07d37563c1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.673015] env[69847]: INFO networking_nsxv3.common.synchronization [req-ef53a46c-3e98-40dc-a98f-9f1d539835ef req-0b77abf1-dc3a-4bea-a256-a6c15ce0559c tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: b99219b4-3c21-4700-b96b-8b480a4d9a62 with Priority: HIGHEST for action security_group_rules [ 1008.673598] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b99219b4-3c21-4700-b96b-8b480a4d9a62 with Priority: HIGHEST for action security_group_rules [ 1008.673988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b99219b4-3c21-4700-b96b-8b480a4d9a62 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.674369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b99219b4-3c21-4700-b96b-8b480a4d9a62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.674369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b99219b4-3c21-4700-b96b-8b480a4d9a62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.674586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b99219b4-3c21-4700-b96b-8b480a4d9a62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.674662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b99219b4-3c21-4700-b96b-8b480a4d9a62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.984746] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6de5dcd6-f74c-430d-ade8-fdb9b51862bd [ 1008.985038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.985195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.985310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.985617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.985745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.985890] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6de5dcd6-f74c-430d-ade8-fdb9b51862bd already deleted. [ 1008.986037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de5dcd6-f74c-430d-ade8-fdb9b51862bd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.008885] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 in Status: SUCCESS [ 1009.009179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.009352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.009566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.009763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.009883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.009947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.010132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.010206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.010289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.010379] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.062056] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.063156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.063156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.063156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.063156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.063156] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port fc2604d7-5708-4d3b-98c7-c9649a7a5439 not found, creating... [ 1009.063401] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.063474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.063575] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.063836] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.063998] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.064332] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.065693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.065693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.065693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.065693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.065693] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: fc2604d7-5708-4d3b-98c7-c9649a7a5439 is going to be created. [ 1009.086432] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.086667] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.086820] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.087122] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.087390] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.087633] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.292467] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.292467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.292467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.292467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.292467] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b99219b4-3c21-4700-b96b-8b480a4d9a62 already deleted. [ 1009.292467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b99219b4-3c21-4700-b96b-8b480a4d9a62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.513693] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.794350] env[69847]: INFO networking_nsxv3.common.synchronization [req-9cb70603-10c7-41b3-a158-cbf589471b05 req-40fcebd6-eee9-4447-a06e-cd0aaefb125c tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1009.794350] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1009.794350] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.795124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.795405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.795794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.797086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.797378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.797560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.797852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.798576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.798799] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.965640] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c5d7e07-a78e-4ffe-a977-d9786660844d req-e0a65fad-3f03-4e23-9a5b-a749bb6e2b43 service nova] Enqueued Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_rules [ 1009.965757] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c5d7e07-a78e-4ffe-a977-d9786660844d req-e0a65fad-3f03-4e23-9a5b-a749bb6e2b43 service nova] Enqueued Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_members [ 1009.965907] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c5d7e07-a78e-4ffe-a977-d9786660844d req-e0a65fad-3f03-4e23-9a5b-a749bb6e2b43 service nova] Enqueued Resource ID: fc2604d7-5708-4d3b-98c7-c9649a7a5439 with Priority: HIGHEST for action port [ 1009.967468] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_rules [ 1009.967468] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_members [ 1009.967468] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc2604d7-5708-4d3b-98c7-c9649a7a5439 with Priority: HIGHEST for action port [ 1009.967468] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.967468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.967468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.967468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.968124] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.969028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.969028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.969028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.969028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.969028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.969028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.969028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.969441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.969441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.969441] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.970113] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc2604d7-5708-4d3b-98c7-c9649a7a5439 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.970234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.970291] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.971695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.971695] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc2604d7-5708-4d3b-98c7-c9649a7a5439',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.015771] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37: rpc.has_security_group_logging(os_id): False [ 1010.033965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.034125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.034251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.034433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.034520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.034853] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.034975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.035040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.035158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.035232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.035317] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 is going to be created. [ 1010.091598] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.091736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.091817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.092045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.092211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.103156] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 in Status: IN_PROGRESS for 2s [ 1010.142605] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.142838] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.142973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.143262] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.143523] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.143707] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.144104] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.144399] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.144609] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.144972] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.145148] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.145294] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.145464] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.145625] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.145760] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.145928] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.173137] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.173719] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.173882] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.174101] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.174422] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.174632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.174765] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.175138] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.175328] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.302393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.302536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.302618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.303068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.303171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.303382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.303496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.303558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.303807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.303892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.303982] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be deleted. [ 1010.306167] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1010.306374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.306838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.306838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.307013] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.307193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.307248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.307414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.307523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.307628] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.336988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.337208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.337208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.337410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.337503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.337606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.472728] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc2604d7-5708-4d3b-98c7-c9649a7a5439 with status ACTIVE [ 1010.472993] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.473169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.473264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.473518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.473636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.473864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.474068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.474105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.474287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.474375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.474602] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.474727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.474802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.475016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.475127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.475225] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc2604d7-5708-4d3b-98c7-c9649a7a5439 is going to be updated. [ 1010.476500] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.476613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.476844] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.495753] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.496131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.496131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.496848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.496848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.496848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc2604d7-5708-4d3b-98c7-c9649a7a5439" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.599914] env[69847]: INFO networking_nsxv3.common.synchronization [req-9558a622-aa51-4b1d-8d06-257187e500c7 req-b96ce427-edf6-42e1-a1f9-b72c1746c2fe tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: ceeab5bb-5e7c-4e19-a44d-c440b7b1a036 with Priority: HIGHEST for action security_group_rules [ 1010.600558] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceeab5bb-5e7c-4e19-a44d-c440b7b1a036 with Priority: HIGHEST for action security_group_rules [ 1010.600883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ceeab5bb-5e7c-4e19-a44d-c440b7b1a036 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.601530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ceeab5bb-5e7c-4e19-a44d-c440b7b1a036" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.601597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ceeab5bb-5e7c-4e19-a44d-c440b7b1a036" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.601943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ceeab5bb-5e7c-4e19-a44d-c440b7b1a036" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.602052] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ceeab5bb-5e7c-4e19-a44d-c440b7b1a036',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.678858] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.679129] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.679296] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.679544] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.679717] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.679888] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 not found, creating... [ 1010.680195] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.680382] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.680505] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.680740] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.680903] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.681206] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.681367] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.681505] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.681721] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.681862] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.682014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 is going to be created. [ 1010.704348] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.704585] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.704720] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.705034] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.705305] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.705573] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.809819] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.809991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.810084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.810289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.810664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.810664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.810819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.810819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.810985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.811038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.811108] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1010.841263] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.841471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.841471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.841705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.841837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.850420] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1010.982329] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.123522] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.123717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.123808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.124056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.124211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.124265] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ceeab5bb-5e7c-4e19-a44d-c440b7b1a036 already deleted. [ 1011.124351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ceeab5bb-5e7c-4e19-a44d-c440b7b1a036" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.396288] env[69847]: INFO networking_nsxv3.common.synchronization [req-9cb70603-10c7-41b3-a158-cbf589471b05 req-1eb1142d-762d-40ff-ad95-70c31a18fb69 service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1011.396850] env[69847]: INFO networking_nsxv3.common.synchronization [req-9cb70603-10c7-41b3-a158-cbf589471b05 req-1eb1142d-762d-40ff-ad95-70c31a18fb69 service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1011.396850] env[69847]: INFO networking_nsxv3.common.synchronization [req-9cb70603-10c7-41b3-a158-cbf589471b05 req-1eb1142d-762d-40ff-ad95-70c31a18fb69 service nova] Enqueued Resource ID: 8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 with Priority: HIGHEST for action port [ 1011.399404] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1011.399404] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1011.399404] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 with Priority: HIGHEST for action port [ 1011.399404] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.399404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.399404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.399404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.399404] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.399652] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.399652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.399730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.399857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.399999] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.400137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.400212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.400301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.400382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.400483] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.401553] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.401671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.401740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.402032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.402032] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.486647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.486811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.487261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.487261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.487438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.487438] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 is going to be created. [ 1011.510697] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.510832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.510979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.512317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.512317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.521424] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 in Status: UNINITIALIZED for 2s [ 1011.903513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.903875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.903875] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 with status ACTIVE [ 1011.904226] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.904357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.904357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.904558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.904720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.905074] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.905074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.905372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.905372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.905461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.905610] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.905661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.905799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.905862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.905925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.906253] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2 is going to be updated. [ 1011.907693] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.926818] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.926984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.927065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.927308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.927977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.927977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f2966a9-c72f-46a5-a1fd-ff3df0c6c1c2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.115328] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 in Status: SUCCESS [ 1012.115600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.410501] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.715499] env[69847]: INFO networking_nsxv3.common.synchronization [req-53f071af-336f-4209-b087-bae0247e86c9 req-06592059-ab81-446a-8c4a-fed7756283ba tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: 0e9197b7-9989-4c78-92c6-199273514659 with Priority: HIGHEST for action security_group_rules [ 1012.715903] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e9197b7-9989-4c78-92c6-199273514659 with Priority: HIGHEST for action security_group_rules [ 1012.716228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e9197b7-9989-4c78-92c6-199273514659 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.716363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e9197b7-9989-4c78-92c6-199273514659" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.716426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e9197b7-9989-4c78-92c6-199273514659" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.716675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e9197b7-9989-4c78-92c6-199273514659" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.716788] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e9197b7-9989-4c78-92c6-199273514659',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.862954] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1012.862954] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee deletion is rescheduled due to dependency. [ 1012.862954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.862954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.862954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.862954] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.862954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.862954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.862954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.863774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.863774] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.913538] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.913964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.913964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.914297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.914474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.914619] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be created. [ 1012.938069] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.938232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.938352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.938552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.938837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.947334] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: UNINITIALIZED for 2s [ 1013.239768] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.239950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.240024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.240199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.240633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.240633] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e9197b7-9989-4c78-92c6-199273514659 already deleted. [ 1013.240633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e9197b7-9989-4c78-92c6-199273514659" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.365723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.365921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.365979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.366673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.366673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.366788] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.366868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.366913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.367079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.367436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.367436] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1013.389722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.389873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.390560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.390560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.390560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.401826] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1013.530995] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 in Status: SUCCESS [ 1013.531319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.531896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.531896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.532244] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.532400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.532711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.532912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.533068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.533210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.533344] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.622066] env[69847]: INFO networking_nsxv3.common.synchronization [req-2378049e-5f16-473f-9097-1ef28c581c4b req-1317fcda-0b68-4248-afa1-7742825ae31f tempest-ServersWithSpecificFlavorTestJSON-1036324866 tempest-ServersWithSpecificFlavorTestJSON-1036324866-project-member] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 1013.622477] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGHEST for action security_group_members [ 1013.622780] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.622904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.622969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.623590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.624743] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.624858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.624929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.625146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.625277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.625399] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.687538] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c1d45c5-a740-47f4-bdd9-378b28450600 req-07e00085-62c6-4b14-be82-d70a8b7edf3b tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1013.688049] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1013.688438] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.688563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.688563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.688765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.688916] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.689018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.691181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.693243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.693458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.693898] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.038807] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.038807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.040356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.043047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.043047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.043047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.043047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.043047] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.093046] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.093046] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.093046] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.093046] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.093046] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.093763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.094096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.094540] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.094877] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.095321] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.095625] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.097445] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.097445] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.097445] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.097445] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.097445] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.121454] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.121454] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.121454] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.121454] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-564" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.121454] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-2a3525e6-0a13-40ae-953c-e6899dd6c407 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.122127] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.122463] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.122983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.123496] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a3525e6-0a13-40ae-953c-e6899dd6c407',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.130056] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.130056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.130056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.130056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.149485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.149485] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.151486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.151486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.152206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.152620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.154117] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be updated. [ 1014.182904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.183264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.183464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.183921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.184224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.196794] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.199796] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: IN_PROGRESS for 2s [ 1014.548150] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d38a5b8-0315-4edd-b894-d3dd2b712ed5: rpc.has_security_group_logging(os_id): False [ 1014.566142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.566587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.566587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.566587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.566919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.566919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.567051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.567051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.567193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.567248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.567526] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.567526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.567677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.567738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.567880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.567954] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.568052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.568142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.568802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.568802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.568802] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 is going to be created. [ 1014.626946] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.627276] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.627459] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.627782] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.627984] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.628167] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 2a3525e6-0a13-40ae-953c-e6899dd6c407 not found, creating... [ 1014.628528] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.628729] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.628868] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.629309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.629309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.632807] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.633129] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.633317] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.633663] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.633967] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.634200] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 2a3525e6-0a13-40ae-953c-e6899dd6c407 is going to be created. [ 1014.637103] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.637832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.637832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.637832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.637960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.657365] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 in Status: IN_PROGRESS for 2s [ 1014.667777] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.667777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.667777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.668146] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.668508] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.668846] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.699632] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.957959] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1014.958242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.958438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.958745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.958968] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.959198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.959306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.959499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.959606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.959718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.959831] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.202558] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.202870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.202870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.203190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.203190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.203269] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1015.213123] env[69847]: INFO networking_nsxv3.common.synchronization [req-449495fb-defb-4f65-852c-687eb9513d1d req-51dcbc64-14be-455c-9650-97679122228a tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: 134c62c1-925d-4e01-875c-b0539f753a94 with Priority: HIGHEST for action security_group_rules [ 1015.213393] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134c62c1-925d-4e01-875c-b0539f753a94 with Priority: HIGHEST for action security_group_rules [ 1015.214016] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-134c62c1-925d-4e01-875c-b0539f753a94 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.214147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-134c62c1-925d-4e01-875c-b0539f753a94" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.214216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-134c62c1-925d-4e01-875c-b0539f753a94" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.214460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-134c62c1-925d-4e01-875c-b0539f753a94" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.214540] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('134c62c1-925d-4e01-875c-b0539f753a94',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.236200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.236383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.236436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.236670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.237428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.246027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1015.345502] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c1d45c5-a740-47f4-bdd9-378b28450600 req-32f3c5e9-802e-4e9f-81fc-7aaf0fc128d0 service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 1015.345680] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c1d45c5-a740-47f4-bdd9-378b28450600 req-32f3c5e9-802e-4e9f-81fc-7aaf0fc128d0 service nova] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1015.345870] env[69847]: INFO networking_nsxv3.common.synchronization [req-1c1d45c5-a740-47f4-bdd9-378b28450600 req-32f3c5e9-802e-4e9f-81fc-7aaf0fc128d0 service nova] Enqueued Resource ID: 2a3525e6-0a13-40ae-953c-e6899dd6c407 with Priority: HIGHEST for action port [ 1015.346648] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_rules [ 1015.347265] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1015.347265] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a3525e6-0a13-40ae-953c-e6899dd6c407 with Priority: HIGHEST for action port [ 1015.347265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.347265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.347265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.347619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.347619] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.348619] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.348708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.348900] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a3525e6-0a13-40ae-953c-e6899dd6c407 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.348995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.349070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.349226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.349298] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a3525e6-0a13-40ae-953c-e6899dd6c407',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.411027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1015.411027] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee deletion is rescheduled due to dependency. [ 1015.411174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.462622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.462752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.462829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.463078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.463226] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.463331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.463384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.463531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.463617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.463705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.463959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.464078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.464078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.464350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.464350] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.464461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.464461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.464912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.464912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.464912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.464912] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.733916] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.734086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.734177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.734389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.734479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.734572] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 134c62c1-925d-4e01-875c-b0539f753a94 already deleted. [ 1015.734653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-134c62c1-925d-4e01-875c-b0539f753a94" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.851048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.851177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.851366] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a3525e6-0a13-40ae-953c-e6899dd6c407 with status ACTIVE [ 1015.851536] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.851646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.851704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.852132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.852207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.852371] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.852460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.852522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.852683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.852761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.852938] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.853040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.853102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.853255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.853316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.853562] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a3525e6-0a13-40ae-953c-e6899dd6c407 is going to be updated. [ 1015.872978] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.873144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.873219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.873421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.873559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.873819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a3525e6-0a13-40ae-953c-e6899dd6c407" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.967548] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 447511d4-51f2-4b25-94d1-cdabf552a536: rpc.has_security_group_logging(os_id): False [ 1015.991438] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.991647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.992181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.992181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.992181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.992391] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.992391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.992391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.992546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.992682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.992791] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.992890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.992949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.993100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.993174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.993352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.993498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.993498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.993648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.993718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.993819] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be created. [ 1016.065784] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.066157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.066349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.067235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.067235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.076339] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1016.211542] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c in Status: SUCCESS [ 1016.212903] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c deletion is rescheduled due to dependency. [ 1016.212903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.671081] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 in Status: SUCCESS [ 1016.671843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.032460] env[69847]: INFO networking_nsxv3.common.synchronization [None req-eb9cf9f0-6105-476a-9d52-874f936cf01f tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1017.032460] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1017.034163] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.034468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.037054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.037054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.037054] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.037054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.037054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.042067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.042067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.042067] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.141785] env[69847]: INFO networking_nsxv3.common.synchronization [req-26a8585d-f4d8-4fdc-a34a-59ea8121fc70 req-8cab6867-9938-44db-b7e0-fadf7726ace0 tempest-ServerActionsV293TestJSON-414194083 tempest-ServerActionsV293TestJSON-414194083-project-member] Enqueued Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_members [ 1017.146083] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d with Priority: HIGHEST for action security_group_members [ 1017.146378] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.150149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.150149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.150149] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.236270] env[69847]: INFO networking_nsxv3.common.synchronization [req-b343aaf6-1235-4b17-bec6-068e59faf0ea req-c2af2394-c709-4cdc-be75-422e8275bafa tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: aa6ae66f-bae9-46c5-8131-07da1885c479 with Priority: HIGHEST for action security_group_rules [ 1017.236835] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6ae66f-bae9-46c5-8131-07da1885c479 with Priority: HIGHEST for action security_group_rules [ 1017.237281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa6ae66f-bae9-46c5-8131-07da1885c479 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.237442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.238307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.238307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.238307] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa6ae66f-bae9-46c5-8131-07da1885c479',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.256313] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1017.256604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.256772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.256990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.257185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.257343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.257419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.257584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.257701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.257832] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.540991] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.650947] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.650947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.651606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.651606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.651606] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.651606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.651606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.651919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.651919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.651919] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d is going to be updated. [ 1017.676994] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.677178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.677265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.677564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.678050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.686561] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d in Status: IN_PROGRESS for 2s [ 1017.760695] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.767083] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.767083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.767083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.767083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.767818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.767818] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa6ae66f-bae9-46c5-8131-07da1885c479 already deleted. [ 1017.767818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.886241] env[69847]: INFO networking_nsxv3.common.synchronization [req-02b772fd-d599-4600-ab8a-21b9bead5850 req-35c6ee60-8b33-41b1-9b4d-4746595a045e tempest-ServersV294TestFqdnHostnames-2038459689 tempest-ServersV294TestFqdnHostnames-2038459689-project-member] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_members [ 1017.886634] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_members [ 1017.886967] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.887103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.887152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.887390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.887542] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.887639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.887699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.887849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.887931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.888087] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.045756] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.059208] env[69847]: INFO networking_nsxv3.common.synchronization [req-2cf20fed-f298-45bf-b9c6-a13c219405fe req-dde8cb01-a14c-4ecd-8f6b-2426da4ce2eb tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: aa6ae66f-bae9-46c5-8131-07da1885c479 with Priority: HIGHEST for action security_group_rules [ 1018.059686] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6ae66f-bae9-46c5-8131-07da1885c479 with Priority: HIGHEST for action security_group_rules [ 1018.060011] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa6ae66f-bae9-46c5-8131-07da1885c479 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.060551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.060625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.060834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.060922] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa6ae66f-bae9-46c5-8131-07da1885c479',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.090587] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1018.090587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.252696] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-171 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.252696] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-171" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.252696] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-171" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.252696] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-171" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.252696] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.252696] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.252696] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.253666] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.256521] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.256521] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.256521] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.256521] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.256521] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.256521] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.256521] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.256521] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.266306] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.275203] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.275203] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.275203] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.275203] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-171" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.275203] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-6831c3b6-1021-4550-8fd2-e99d6fc8002a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.275203] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.275203] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.275764] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.276091] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6831c3b6-1021-4550-8fd2-e99d6fc8002a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.393252] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.393433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.393503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.393713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.393834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.394040] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.394143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.394208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.394352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.394425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.394930] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb already deleted. [ 1018.396459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.549087] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.549243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.549322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.550440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.550556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.550644] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1018.583490] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.583699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.583699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.584068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.584160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.584275] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa6ae66f-bae9-46c5-8131-07da1885c479 already deleted. [ 1018.584362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.585412] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.585549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.585586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.585792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.585933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.594758] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1018.769847] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.770034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.770128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.770337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.770427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.770527] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1018.778982] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.779288] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.779373] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.779592] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.779742] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.779892] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 6831c3b6-1021-4550-8fd2-e99d6fc8002a not found, creating... [ 1018.780167] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.780327] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.780449] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.784835] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.785045] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.785358] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.785524] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.785648] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.785875] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.786122] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.786291] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 6831c3b6-1021-4550-8fd2-e99d6fc8002a is going to be created. [ 1018.799931] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.800096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.800154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.800348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.800567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.804598] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.804805] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.804960] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.805372] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.805458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.805653] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.808186] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1018.982584] env[69847]: INFO networking_nsxv3.common.synchronization [req-0227ea7a-684d-4c4b-aca2-e67e4f472fb3 req-e932c120-56f3-402d-bf7d-c29a51bb3956 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1018.983184] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1018.983504] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.983637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.983704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.984039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.984480] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.984726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.984726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.985131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.985131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.985287] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.488013] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.488297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.488297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.488373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.489057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.489057] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.489057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.489057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.489057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.489057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.489501] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 1019.514938] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.518017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.518017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.518017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.518017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.524642] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 1019.690291] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.690291] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.690291] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.690483] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.691039] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.693340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.693340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.693340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.693340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.693340] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.693340] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.693340] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.693340] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.693340] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.693340] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.693636] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.703029] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d in Status: SUCCESS [ 1019.703029] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d deletion is rescheduled due to dependency. [ 1019.703029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.715022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.715022] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.715022] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.715022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.715022] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.715022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.715022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.715022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.715022] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.885281] env[69847]: INFO networking_nsxv3.common.synchronization [req-02b772fd-d599-4600-ab8a-21b9bead5850 req-2ff254f8-2f64-4aab-8610-f94aaa6d15f8 service nova] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_rules [ 1019.885281] env[69847]: INFO networking_nsxv3.common.synchronization [req-02b772fd-d599-4600-ab8a-21b9bead5850 req-2ff254f8-2f64-4aab-8610-f94aaa6d15f8 service nova] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_members [ 1019.885281] env[69847]: INFO networking_nsxv3.common.synchronization [req-02b772fd-d599-4600-ab8a-21b9bead5850 req-2ff254f8-2f64-4aab-8610-f94aaa6d15f8 service nova] Enqueued Resource ID: 6831c3b6-1021-4550-8fd2-e99d6fc8002a with Priority: HIGHEST for action port [ 1019.885281] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_rules [ 1019.885581] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_members [ 1019.885918] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6831c3b6-1021-4550-8fd2-e99d6fc8002a with Priority: HIGHEST for action port [ 1019.886651] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.887273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.887273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.890031] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.890031] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.890031] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.890031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.890031] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.892294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6831c3b6-1021-4550-8fd2-e99d6fc8002a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.892578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.892980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.893854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.894111] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6831c3b6-1021-4550-8fd2-e99d6fc8002a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.133768] env[69847]: INFO networking_nsxv3.common.synchronization [req-639bbe7c-3ed1-44cd-92d2-ae0084fa7acb req-bba46b8e-ccee-4fdd-ab36-81c5468bb387 tempest-SecurityGroupRulesTestJSON-1409027247 tempest-SecurityGroupRulesTestJSON-1409027247-project-member] Enqueued Resource ID: aa6ae66f-bae9-46c5-8131-07da1885c479 with Priority: HIGHEST for action security_group_rules [ 1020.134898] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6ae66f-bae9-46c5-8131-07da1885c479 with Priority: HIGHEST for action security_group_rules [ 1020.135624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa6ae66f-bae9-46c5-8131-07da1885c479 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.135958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.136133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.136449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.137957] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa6ae66f-bae9-46c5-8131-07da1885c479',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.218369] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.221030] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca not found, creating... [ 1020.221030] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.221030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.221650] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.224394] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.224394] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.224394] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.224394] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.224394] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca is going to be created. [ 1020.245321] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.245804] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.247022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.247022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.247022] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.247567] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.397648] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.398780] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.399232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.404488] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6831c3b6-1021-4550-8fd2-e99d6fc8002a with status ACTIVE [ 1020.404884] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.404884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.404884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.405224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.405224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.405381] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.405487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.405546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.405725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.405823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.406013] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.406149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.406217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.406354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.406428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.406510] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6831c3b6-1021-4550-8fd2-e99d6fc8002a is going to be updated. [ 1020.436777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.436777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.436777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.437025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.437025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.437166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6831c3b6-1021-4550-8fd2-e99d6fc8002a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.612357] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1020.612357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.663455] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.663782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.663782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.664036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.664513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.664513] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa6ae66f-bae9-46c5-8131-07da1885c479 already deleted. [ 1020.664513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa6ae66f-bae9-46c5-8131-07da1885c479" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.817748] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1020.818249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.818432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.818643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.818841] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.818947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.819029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.819173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.819255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.819338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.819425] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.905662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.219315] env[69847]: INFO networking_nsxv3.common.synchronization [req-ea0668f8-20d0-4e5e-8edc-31513a0bb166 req-20efb8ab-80ed-41bc-b74b-f2114bb45d54 service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1021.219532] env[69847]: INFO networking_nsxv3.common.synchronization [req-ea0668f8-20d0-4e5e-8edc-31513a0bb166 req-20efb8ab-80ed-41bc-b74b-f2114bb45d54 service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1021.219687] env[69847]: INFO networking_nsxv3.common.synchronization [req-ea0668f8-20d0-4e5e-8edc-31513a0bb166 req-20efb8ab-80ed-41bc-b74b-f2114bb45d54 service nova] Enqueued Resource ID: c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca with Priority: HIGHEST for action port [ 1021.220484] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1021.220618] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1021.221251] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca with Priority: HIGHEST for action port [ 1021.223496] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.223711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.224488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.224488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.224488] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.225584] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.225584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.225584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.225731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.225777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.225873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.225933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.226084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.226258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.226361] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.228831] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.228944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.230395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.232157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.232157] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.321658] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.322131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.322213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.322448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.322628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.322735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.322799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.322965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.323066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.323157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.323315] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.323407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.323463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.323605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.323741] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.324013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.324154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.324395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.324527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.324764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.325055] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.409025] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.409025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.409025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.409025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.409025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.409025] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb is going to be created. [ 1021.433020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.433020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.433020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.433020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.433020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.440208] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb in Status: UNINITIALIZED for 2s [ 1021.536020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 1021.536020] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe deletion is rescheduled due to dependency. [ 1021.536020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.732827] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.735110] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.735110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.735110] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca with status ACTIVE [ 1021.735110] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.735110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.735110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.735353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.735353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.735519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.737150] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.737150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.737150] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca is going to be updated. [ 1021.757654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.757797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.757905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.758075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.758222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.758380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c853fcdb-e21d-4a0f-ab4b-e1c6da2dbfca" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.828477] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 320d8032-7c7f-4adf-9aaa-d27d0fb2efff: rpc.has_security_group_logging(os_id): False [ 1021.854679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.858204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.858204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.858204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.859277] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.859277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.859277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.859277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.859277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.859277] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1021.928867] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.929096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.929096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.929254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.929397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.945823] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1022.235415] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.572666] env[69847]: INFO networking_nsxv3.common.synchronization [req-85e93918-cc15-4159-ae7e-e97237db46d2 req-7bf6cd40-2e3b-48bf-8a0f-e2623df97afc tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1022.573223] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1022.574245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.574245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.574245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.574245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.574245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.574445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.574445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.574575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.574683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.574792] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.738942] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.739284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.739284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.739430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.740620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.740620] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1022.785807] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.786102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.786363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.786687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.786769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.805053] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1023.076894] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.118423] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.118632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.118762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.119040] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.119302] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.119462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.119582] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.119810] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.119955] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.120331] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.120457] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.120568] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.120709] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.120947] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1023.120947] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.121221] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.138350] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.138518] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1023.138659] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.138835] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.139158] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-e10094b8-4c4b-46b4-bb1c-0a501026b224 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.139330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.139451] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.139773] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.139914] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e10094b8-4c4b-46b4-bb1c-0a501026b224',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.450321] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb in Status: SUCCESS [ 1023.450563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.450732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.450957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.451173] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.451297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.451363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.451529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.451611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.451698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.452058] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.581223] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.644024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.644024] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port e10094b8-4c4b-46b4-bb1c-0a501026b224 not found, creating... [ 1023.644024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.644024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.644600] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.644600] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.644600] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.644705] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.644870] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.645082] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.645264] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: e10094b8-4c4b-46b4-bb1c-0a501026b224 is going to be created. [ 1023.664848] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.664848] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.665043] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.665181] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.665411] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.665634] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.957355] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.961175] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1023.961372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.083436] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.083855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.084071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.084370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.084556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.084739] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1024.110304] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.110304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.110304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.110570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.110570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.120126] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1024.460263] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 787bb710-aa55-4d74-8a05-06d3f5d80ddb: rpc.has_security_group_logging(os_id): False [ 1024.478893] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.479083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.479123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.479558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.479678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.480054] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.480189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.480280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.480516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.480608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.480690] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb is going to be created. [ 1024.538411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.538830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.538830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.538988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.539254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.548977] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb in Status: IN_PROGRESS for 2s [ 1024.562875] env[69847]: INFO networking_nsxv3.common.synchronization [req-85e93918-cc15-4159-ae7e-e97237db46d2 req-154c32a4-c6ab-4e9f-acff-4394e2fdada7 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1024.563768] env[69847]: INFO networking_nsxv3.common.synchronization [req-85e93918-cc15-4159-ae7e-e97237db46d2 req-154c32a4-c6ab-4e9f-acff-4394e2fdada7 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1024.564056] env[69847]: INFO networking_nsxv3.common.synchronization [req-85e93918-cc15-4159-ae7e-e97237db46d2 req-154c32a4-c6ab-4e9f-acff-4394e2fdada7 service nova] Enqueued Resource ID: e10094b8-4c4b-46b4-bb1c-0a501026b224 with Priority: HIGHEST for action port [ 1024.564334] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1024.566708] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1024.566708] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e10094b8-4c4b-46b4-bb1c-0a501026b224 with Priority: HIGHEST for action port [ 1024.566708] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.566708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.566708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.566708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.566708] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.568305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.568305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.568305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e10094b8-4c4b-46b4-bb1c-0a501026b224 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.568576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.568576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.568847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.568847] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e10094b8-4c4b-46b4-bb1c-0a501026b224',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.815441] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1024.815695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.815880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.816119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.816338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.816463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.816538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.816684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.816787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.816915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.817060] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.071089] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.071520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.071520] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e10094b8-4c4b-46b4-bb1c-0a501026b224 with status ACTIVE [ 1025.072182] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.072182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.072182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.072182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.072182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.073229] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.073229] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.073229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.073229] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e10094b8-4c4b-46b4-bb1c-0a501026b224 is going to be updated. [ 1025.095740] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.095891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.096032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.096175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.096319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.096475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e10094b8-4c4b-46b4-bb1c-0a501026b224" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.102024] env[69847]: INFO networking_nsxv3.common.synchronization [req-c46c2566-d2f5-42b2-a1be-dcb027889939 req-056ea189-cced-475e-9bcb-56a626225cc8 tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1025.102686] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1025.103036] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.103169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.103255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.103501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.103687] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.103792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.103886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.104105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.104169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.104276] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.319243] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.319463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.319514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.319767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.319964] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.320096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.320179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.320352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.320720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.320720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.320720] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.320832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.320832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.321035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.321116] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.321164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.321224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.321360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.321435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.321515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.321603] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.554840] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.554840] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.554840] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.554840] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.556007] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.556007] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.556007] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.556007] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.556517] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.556517] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.556517] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.556634] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.556685] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.556792] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.556905] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.557049] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.580305] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.580465] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.580604] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.580781] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.581123] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-a56a1f10-b9b7-42eb-9502-c6210287139b taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.581375] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.581503] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.581818] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.581961] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56a1f10-b9b7-42eb-9502-c6210287139b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.609605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.609605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.609605] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 already deleted. [ 1025.609605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.823849] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 447511d4-51f2-4b25-94d1-cdabf552a536: rpc.has_security_group_logging(os_id): False [ 1025.842167] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.842355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.842355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.842579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.842667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.842880] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.842973] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.843045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.843193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.844979] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.844979] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.844979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.846158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.846158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.846158] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1025.901483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.901660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.901771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.901954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.902120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.913057] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1026.085519] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.085847] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.085932] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.086545] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.086750] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.087017] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port a56a1f10-b9b7-42eb-9502-c6210287139b not found, creating... [ 1026.087422] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.087510] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.087611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.087897] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.088055] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.088368] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.088531] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.088665] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.088963] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.089034] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.089178] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: a56a1f10-b9b7-42eb-9502-c6210287139b is going to be created. [ 1026.114495] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.114495] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.114495] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.114495] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.114663] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.114949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.129814] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1026.130048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.130208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.130420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.130608] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.130734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.130798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.130953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.131059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.131160] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.559699] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb in Status: SUCCESS [ 1026.559953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.635718] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.724169] env[69847]: INFO networking_nsxv3.common.synchronization [req-2a8077e3-0b57-4af4-8dc9-d09cbf009a72 req-b000aac9-8cc8-4bdd-9454-00e1886ee8b0 tempest-MigrationsAdminTest-1749055771 tempest-MigrationsAdminTest-1749055771-project-member] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 1026.724736] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 1026.725233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.725370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.725433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.725643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.726094] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.726094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.726094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.726094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.726332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.726332] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.141080] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.228011] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.397118] env[69847]: INFO networking_nsxv3.common.synchronization [req-728b2b1a-26f8-4bce-a513-634628717d1e req-74f7315d-27ce-4583-a89e-cecef4dd0858 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1027.400559] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1027.400559] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.400559] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.400559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.400559] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.426089] env[69847]: INFO networking_nsxv3.common.synchronization [req-728b2b1a-26f8-4bce-a513-634628717d1e req-74f7315d-27ce-4583-a89e-cecef4dd0858 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 1027.426266] env[69847]: INFO networking_nsxv3.common.synchronization [req-728b2b1a-26f8-4bce-a513-634628717d1e req-74f7315d-27ce-4583-a89e-cecef4dd0858 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1027.426411] env[69847]: INFO networking_nsxv3.common.synchronization [req-728b2b1a-26f8-4bce-a513-634628717d1e req-74f7315d-27ce-4583-a89e-cecef4dd0858 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 02aca41c-3d71-4830-b576-0acd93f13063 with Priority: HIGHEST for action port [ 1027.427033] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 1027.427157] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1027.427256] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca41c-3d71-4830-b576-0acd93f13063 with Priority: HIGHEST for action port [ 1027.427522] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.427633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.428207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.428207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.428207] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.429048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.429153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.429356] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-02aca41c-3d71-4830-b576-0acd93f13063 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.429461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.429537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.430056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.430153] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02aca41c-3d71-4830-b576-0acd93f13063',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.439804] env[69847]: INFO networking_nsxv3.common.synchronization [req-f61da7da-3aeb-4eb4-b70c-445cfcbcf5b6 req-c3f103ad-d4ce-4373-a512-06720f6539d2 tempest-ServersNegativeTestMultiTenantJSON-1819460926 tempest-ServersNegativeTestMultiTenantJSON-1819460926-project-member] Enqueued Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_members [ 1027.440278] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGHEST for action security_group_members [ 1027.441200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.441200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.441200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.441200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.441200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.441423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.441423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.441423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.441515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.441631] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.575952] env[69847]: INFO networking_nsxv3.common.synchronization [req-c46c2566-d2f5-42b2-a1be-dcb027889939 req-794e5fbe-bf0a-40ca-ae37-8b1349b0bee0 service nova] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1027.575952] env[69847]: INFO networking_nsxv3.common.synchronization [req-c46c2566-d2f5-42b2-a1be-dcb027889939 req-794e5fbe-bf0a-40ca-ae37-8b1349b0bee0 service nova] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1027.575952] env[69847]: INFO networking_nsxv3.common.synchronization [req-c46c2566-d2f5-42b2-a1be-dcb027889939 req-794e5fbe-bf0a-40ca-ae37-8b1349b0bee0 service nova] Enqueued Resource ID: a56a1f10-b9b7-42eb-9502-c6210287139b with Priority: HIGHEST for action port [ 1027.576083] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1027.576190] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1027.576271] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56a1f10-b9b7-42eb-9502-c6210287139b with Priority: HIGHEST for action port [ 1027.576787] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.576911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.576969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.577382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.577463] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.582078] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.582078] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.582078] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.582078] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a56a1f10-b9b7-42eb-9502-c6210287139b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.582078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.582078] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56a1f10-b9b7-42eb-9502-c6210287139b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.643631] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.643793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.643887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.644259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.644374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.644484] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1027.673396] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.673737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.673888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.674177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.677991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.688136] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1027.732197] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.905288] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.925756] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1027.925965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.931598] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.931725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.935642] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02aca41c-3d71-4830-b576-0acd93f13063 with status ACTIVE [ 1027.936250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.936250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.936250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.936438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.936438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.936591] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.936686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.936753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.936907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.936986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.937716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.937716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.937716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.937716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.937716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.937716] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02aca41c-3d71-4830-b576-0acd93f13063 is going to be updated. [ 1027.944694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.944873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.946022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.946022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.946022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 is going to be updated. [ 1027.961279] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.961473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.961473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.961675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.961830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.962008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.969930] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.970091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.970140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.970430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.970430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.977687] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 in Status: IN_PROGRESS for 2s [ 1028.084020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.084543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.084924] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.086414] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a56a1f10-b9b7-42eb-9502-c6210287139b with status ACTIVE [ 1028.086679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.086842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.086935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.090836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.091200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.091264] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.091383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.091468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.091806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.091806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.092085] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.092231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.092323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.092526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.092637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.092761] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a56a1f10-b9b7-42eb-9502-c6210287139b is going to be updated. [ 1028.115295] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.115425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.115492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.115678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.115806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.115954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.236622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.236936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.236936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.237246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.237362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.237522] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be updated. [ 1028.277595] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.277595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.277595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.277806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.277806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.289248] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 1028.407825] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.597851] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.912381] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.912555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.912628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.912861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.912965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.913113] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be updated. [ 1028.928020] env[69847]: INFO networking_nsxv3.common.synchronization [req-ad7b9db9-dc14-4d2e-a16b-a8b58d8b97c4 req-03dea170-908c-4bc8-830b-e70c08ec4f29 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1028.928020] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1028.928020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.928020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.928020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.928020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.947153] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.947338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.947397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.947630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.947752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.958030] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: IN_PROGRESS for 2s [ 1029.099897] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.100048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.100154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.100404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.100765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.100765] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 is going to be created. [ 1029.130372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.130372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.130584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.130751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.130928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.145087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: UNINITIALIZED for 2s [ 1029.430879] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.430879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.431186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.431186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.431273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.431859] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.431859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.431859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.431859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.431859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.431859] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be updated. [ 1029.459686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.459686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.459686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.459686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.459686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.467480] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: IN_PROGRESS for 2s [ 1029.701643] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1029.701889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.702074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.702289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.702485] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.702595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.702659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.702811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.702913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.702979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.703086] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.987940] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 in Status: SUCCESS [ 1029.988039] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 deletion is rescheduled due to dependency. [ 1029.988158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.207991] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.207991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.207991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.207991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.208314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.208384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.208493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.208617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.208700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.208805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.208967] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.209101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.209198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.209359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.209546] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.209645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.209738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.209894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.209977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.210076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.210162] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.300933] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 1030.301201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.712853] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 1030.731744] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.731990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.732100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.732311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.732398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.732588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.732685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.732748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.732892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.732967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.733177] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.733272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.733322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.733459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.733531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.733775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.733877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.733991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.734153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.734229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.734314] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1030.792842] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.793138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.793138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.793345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.793487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.806112] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1030.972052] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: SUCCESS [ 1030.972275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.972443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.972660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.972845] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.972964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.973042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.973199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.973278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.973370] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.155597] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: SUCCESS [ 1031.155796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.155966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.156260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.156428] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.156553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.156626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.156791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.156873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.156960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.157077] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.476587] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.480120] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: SUCCESS [ 1031.480120] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 deletion is rescheduled due to dependency. [ 1031.480120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.659926] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.676337] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a9c2733-08c5-47fc-bcc7-4731a23a066c req-bd6abf74-eecb-497c-9aae-9254a1a2e837 tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1031.676968] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1031.677360] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.677478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.677545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.677744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.677911] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.678285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.678285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.678285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.678442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.678442] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.681727] env[69847]: INFO networking_nsxv3.common.synchronization [req-41252f0a-151b-4b5c-b96b-da8dfd6b94ab req-fd29f3e5-6c5d-444d-80ae-75373f705210 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1031.682062] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1031.682551] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.682656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.732178] env[69847]: INFO networking_nsxv3.common.synchronization [req-41252f0a-151b-4b5c-b96b-da8dfd6b94ab req-fd29f3e5-6c5d-444d-80ae-75373f705210 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 1031.732564] env[69847]: INFO networking_nsxv3.common.synchronization [req-41252f0a-151b-4b5c-b96b-da8dfd6b94ab req-fd29f3e5-6c5d-444d-80ae-75373f705210 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1031.732564] env[69847]: INFO networking_nsxv3.common.synchronization [req-41252f0a-151b-4b5c-b96b-da8dfd6b94ab req-fd29f3e5-6c5d-444d-80ae-75373f705210 tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 02aca41c-3d71-4830-b576-0acd93f13063 with Priority: HIGHEST for action port [ 1031.733080] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_rules [ 1031.733636] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1031.733953] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02aca41c-3d71-4830-b576-0acd93f13063 with Priority: HIGHEST for action port [ 1031.734268] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.734375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.734573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.734674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.734828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-02aca41c-3d71-4830-b576-0acd93f13063 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.734943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.735068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.735307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.735399] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02aca41c-3d71-4830-b576-0acd93f13063',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.978321] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.115503] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.115772] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.115949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.120019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.120019] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.120019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.120019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.120019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.120019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.120019] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.120019] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.120019] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.120019] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.120019] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.120776] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.120976] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.146689] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.146689] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.146689] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.146689] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-137" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.146689] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-6de69ddf-56db-4de7-a3a5-67aece93be6d taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.146689] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.146689] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.146689] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.146689] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de69ddf-56db-4de7-a3a5-67aece93be6d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.162952] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70472fc2-8f2e-4656-96c9-97081b657aa2: rpc.has_security_group_logging(os_id): False [ 1032.181260] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.181260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.181260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.181260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.181260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.181945] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.182676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.182794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.183165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.183314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.183466] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 is going to be created. [ 1032.185403] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.185505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.185572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.185922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.186026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.186253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.186353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.186412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.186569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.186642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.186726] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 1032.220257] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.220437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.220511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.220769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.220947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.230909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 1032.237618] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02aca41c-3d71-4830-b576-0acd93f13063 with status ACTIVE [ 1032.237977] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.238257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.238348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.238620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.239296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.239611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.239767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.239865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.240162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.240317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.240615] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.240743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.241066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.241066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.241188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.241343] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02aca41c-3d71-4830-b576-0acd93f13063 is going to be updated. [ 1032.253028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.253028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.253028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.253028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.253028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.265044] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: IN_PROGRESS for 2s [ 1032.267666] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.268166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.268166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.268166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.268424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02aca41c-3d71-4830-b576-0acd93f13063" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.487210] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.487210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.487210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.487210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.487210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.487210] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be updated. [ 1032.649836] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.650221] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.650221] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.651607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.651607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.651607] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 6de69ddf-56db-4de7-a3a5-67aece93be6d not found, creating... [ 1032.651607] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.651607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.651607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.651923] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.651923] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.652077] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.652231] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.652342] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.652579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.652708] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.652844] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 6de69ddf-56db-4de7-a3a5-67aece93be6d is going to be created. [ 1032.673607] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.673820] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.673994] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.674306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.674561] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.674827] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.682824] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.683051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.683051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.683237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.683443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.691795] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: IN_PROGRESS for 2s [ 1032.841221] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1032.841617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.587239] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a9c2733-08c5-47fc-bcc7-4731a23a066c req-c47e4fe1-30d9-4e0b-adfb-aefa4dfe79cd service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 1033.587431] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a9c2733-08c5-47fc-bcc7-4731a23a066c req-c47e4fe1-30d9-4e0b-adfb-aefa4dfe79cd service nova] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1033.587570] env[69847]: INFO networking_nsxv3.common.synchronization [req-6a9c2733-08c5-47fc-bcc7-4731a23a066c req-c47e4fe1-30d9-4e0b-adfb-aefa4dfe79cd service nova] Enqueued Resource ID: 6de69ddf-56db-4de7-a3a5-67aece93be6d with Priority: HIGHEST for action port [ 1033.590876] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_rules [ 1033.590876] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1033.590876] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de69ddf-56db-4de7-a3a5-67aece93be6d with Priority: HIGHEST for action port [ 1033.590876] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.590876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.591192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.591348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.591436] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.592734] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.593458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.593691] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de69ddf-56db-4de7-a3a5-67aece93be6d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.593832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.593919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.594702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.594702] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de69ddf-56db-4de7-a3a5-67aece93be6d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.098774] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.102280] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6de69ddf-56db-4de7-a3a5-67aece93be6d with status ACTIVE [ 1034.102280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.102280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.102280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.102280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.103043] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6de69ddf-56db-4de7-a3a5-67aece93be6d is going to be updated. [ 1034.124895] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.124895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.124895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.124895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.124895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.124895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de69ddf-56db-4de7-a3a5-67aece93be6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.244369] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 1034.244369] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe deletion is rescheduled due to dependency. [ 1034.244369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.244525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.244674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.244848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.244994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.245154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.245278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.245278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.245435] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.277850] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: SUCCESS [ 1034.278120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.702581] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: SUCCESS [ 1034.702757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.702922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.703174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.703369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.703512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.703575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.703773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.703773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.703876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.704086] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.704834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.705314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.705314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.705463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.705463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.705565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.705610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.705741] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.748026] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.207082] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.210019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.255835] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.709370] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a5d4244-b087-44e4-8f75-cde4173fe0e5: rpc.has_security_group_logging(os_id): False [ 1035.714844] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.735372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.735565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.735608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.736026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.736026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.736347] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.736478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.736554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.736725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.736816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.736937] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be updated. [ 1035.757119] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.757290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.757373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.757595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.757699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.757801] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 1035.783505] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.783819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.784018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.784555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.785009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.795805] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 1035.803198] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.803370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.803820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.804129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.804318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.819614] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: IN_PROGRESS for 2s [ 1035.990104] env[69847]: INFO networking_nsxv3.common.synchronization [req-0d6aac61-f1b0-4e36-892e-62eeabcfdfaf req-77c7a612-a5da-4342-b373-1976cd115d7f tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1035.991486] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1035.991486] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.991486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.991486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.991486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.991725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.991790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.991868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.992029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.992112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.992203] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.215510] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.215843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.215843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.215940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.215995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.216123] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be updated. [ 1036.253479] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.253649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.253686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.254249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.254249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.286334] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: IN_PROGRESS for 2s [ 1036.495827] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.708871] env[69847]: INFO networking_nsxv3.common.synchronization [req-1a7f4242-c798-4588-90d6-47a747381d4d req-72046821-7bff-4fe6-815c-390f58cbbeef tempest-AttachInterfacesUnderV243Test-1736786536 tempest-AttachInterfacesUnderV243Test-1736786536-project-member] Enqueued Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1036.709310] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 with Priority: HIGHEST for action security_group_members [ 1036.709664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a5d4244-b087-44e4-8f75-cde4173fe0e5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.709792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.973019] env[69847]: INFO networking_nsxv3.common.synchronization [None req-26429efd-3d00-4f53-a061-018c0ab8a710 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1036.973904] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1036.974398] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.974510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.000994] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.500370] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.500838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.500838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.501277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.501277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.501277] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1037.528593] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.528593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.528593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.529812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.530024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.539736] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1037.805635] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 1037.805969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.806230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.806557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.806821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.806988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.807100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.807327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.807467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.807599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.807727] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.833144] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: SUCCESS [ 1037.833431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.834020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.834290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.834410] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.303185] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 in Status: SUCCESS [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.303185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.303185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.303185] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.310280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.310726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.310915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.311384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.313316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.313430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.313498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.313683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.313765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.313853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.314066] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.314209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.314285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.314454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.315861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.315861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.315861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.315861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.315861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.315861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.315861] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.360588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.360588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.360588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.360588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.360588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.360588] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be deleted. [ 1038.412578] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.412578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.412578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.412578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.412578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.412578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.806411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.806411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.806411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.806411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.806411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.806411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.806411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.806411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.806909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.806909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.806909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 is going to be deleted. [ 1038.821361] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b495386a-9f65-4bd6-a72b-2cc4c5b333fe: rpc.has_security_group_logging(os_id): False [ 1038.838854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.839403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.839982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.839982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.839982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.840286] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.840435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.840527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.841764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.841937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.842190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.842541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.842541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.842681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.842854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.843135] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.843751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.843751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.843751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.843751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.843751] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 1038.845815] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.845815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.845815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.846518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.846843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.846843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.847717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.847978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.848533] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.848533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.848533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.848533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.848533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.848844] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a5d4244-b087-44e4-8f75-cde4173fe0e5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.909538] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-de116a0a-4fbf-4603-95da-38caadddc47a tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1038.909538] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1038.909538] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.909766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.909921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.910208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.910478] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.910685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.910819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.911062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.911235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.911431] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.937584] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.937584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.937584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.938812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.939375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.958242] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 1039.353810] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.353810] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.353810] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a5d4244-b087-44e4-8f75-cde4173fe0e5 already deleted. [ 1039.353810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a5d4244-b087-44e4-8f75-cde4173fe0e5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.400275] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-08da6fd0-ebb4-489a-9472-4377d30fc6a5 tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1039.400275] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1039.401041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.401041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.414211] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.414667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.414667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.414773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.414811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.415038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.415133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.415195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.415423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.415548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.416426] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1039.449999] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.450915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.451015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.451279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.451430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.466197] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1039.554279] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1039.554775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.555433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.555433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.555560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.555891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.556054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.556287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.556418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.556971] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.913669] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.913669] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-573" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.914114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-573" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.914184] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-573" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.915306] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.915306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.915306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.915306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.915306] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.915306] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.922129] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.922129] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.922129] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.922129] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1039.922129] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.922129] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.937871] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.938085] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.938234] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.938455] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-573" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.938822] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.939087] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.939197] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.939546] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.939725] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.060205] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.060353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.060423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.060640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.060983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.060983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.061119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.061119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.061296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.061429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.061474] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1040.091163] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.091308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.091375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.091593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.091736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.105368] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1040.442491] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.442774] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.442968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.443340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.443580] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.443811] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 not found, creating... [ 1040.444188] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.444388] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.444584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.444878] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.445164] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.445524] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.445733] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.445843] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.447396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.447594] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.447779] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 is going to be created. [ 1040.467235] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.467461] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.467575] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.467892] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.468162] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.468422] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.973109] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 1040.973395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.475967] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1041.476169] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee deletion is rescheduled due to dependency. [ 1041.477160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.477160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.477160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.477160] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.477160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.477160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.477489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.477489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.477576] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.531198] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-f62f210d-bfb7-45b6-8514-3c34abf89caf service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 1041.531198] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-f62f210d-bfb7-45b6-8514-3c34abf89caf service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1041.531198] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-f62f210d-bfb7-45b6-8514-3c34abf89caf service nova] Enqueued Resource ID: 9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 with Priority: HIGHEST for action port [ 1041.531198] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 1041.531198] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1041.531198] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 with Priority: HIGHEST for action port [ 1041.531198] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.531198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.531198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.533663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.533663] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.534749] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.534910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.535429] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.535625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.535625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.536229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.536229] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.538266] env[69847]: INFO networking_nsxv3.common.synchronization [req-17d4a7bd-a58f-421a-b8a8-42235574f319 req-9b2687e2-b8a1-4200-878a-1834da57ed05 tempest-MigrationsAdminTest-1749055771 tempest-MigrationsAdminTest-1749055771-project-member] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 1041.538882] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGHEST for action security_group_members [ 1041.539237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.539292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.540479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.540730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.540910] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.541022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.541503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.542532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.542532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.542532] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.982329] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.039435] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 with status ACTIVE [ 1042.039734] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.039872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.039938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.040160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.040251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.040425] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.040519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.040580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.040722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.040794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.040970] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.041077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.041138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.041273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.041344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.041426] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68 is going to be updated. [ 1042.045299] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.045299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.045618] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.045723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.045788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.045945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.046048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.046248] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.046342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.046408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.046544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.046614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.046698] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be updated. [ 1042.079264] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.079405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.079471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.079670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.079803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.079955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f784a3b-fefa-4fb0-9aa3-c9a1278a4a68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.089746] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.089746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.089746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.089746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.089746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.099744] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: IN_PROGRESS for 2s [ 1042.116025] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1042.116025] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 deletion is rescheduled due to dependency. [ 1042.117960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.484437] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.531704] env[69847]: INFO networking_nsxv3.common.synchronization [None req-ed6d1fc3-6b2a-4dbd-89a7-73ec5cd03807 None None] Enqueued Resource ID: 05799aa6-0092-4f63-b291-f6c6a355636d with Priority: HIGHEST for action port [ 1042.531704] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05799aa6-0092-4f63-b291-f6c6a355636d with Priority: HIGHEST for action port [ 1042.532206] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-05799aa6-0092-4f63-b291-f6c6a355636d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.532324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05799aa6-0092-4f63-b291-f6c6a355636d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.532442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05799aa6-0092-4f63-b291-f6c6a355636d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.532631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05799aa6-0092-4f63-b291-f6c6a355636d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.532709] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05799aa6-0092-4f63-b291-f6c6a355636d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.715590] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-942 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.715590] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-942" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.715764] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-942" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.715934] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-942" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.716269] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.716419] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.716509] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.716727] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.717562] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.717562] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.717562] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.717562] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.717562] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.717562] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.717808] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.717808] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.738771] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.739597] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.739597] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.739597] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-942" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.739597] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-79226bb0-cd7a-40be-a6ae-6d5edd485868 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.739798] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.740233] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.740610] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.740690] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79226bb0-cd7a-40be-a6ae-6d5edd485868',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.989064] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.989357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.989357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.989519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.989600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.990318] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1043.019483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.019631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.019702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.019901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.020071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.030064] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1043.035094] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05799aa6-0092-4f63-b291-f6c6a355636d [ 1043.035356] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.035487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.035545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.035746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.035831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.035924] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05799aa6-0092-4f63-b291-f6c6a355636d already deleted. [ 1043.036011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05799aa6-0092-4f63-b291-f6c6a355636d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.244591] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.244752] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.244881] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.245224] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.245409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245536] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 79226bb0-cd7a-40be-a6ae-6d5edd485868 not found, creating... [ 1043.245796] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.245949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.246080] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.246588] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.246588] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.246858] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.247030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.248949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.252424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.252424] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.252424] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 79226bb0-cd7a-40be-a6ae-6d5edd485868 is going to be created. [ 1043.272217] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.272428] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.272549] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.272823] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.273067] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.273294] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.109678] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d in Status: SUCCESS [ 1044.110472] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d deletion is rescheduled due to dependency. [ 1044.110636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.305427] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-e761f5d5-440c-47e4-8a1f-4a62d0f47fe3 service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 1044.307400] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-e761f5d5-440c-47e4-8a1f-4a62d0f47fe3 service nova] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1044.307557] env[69847]: INFO networking_nsxv3.common.synchronization [req-0f462b98-b3ef-48fd-a042-9ac64d73e84c req-e761f5d5-440c-47e4-8a1f-4a62d0f47fe3 service nova] Enqueued Resource ID: 79226bb0-cd7a-40be-a6ae-6d5edd485868 with Priority: HIGHEST for action port [ 1044.308140] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_rules [ 1044.308288] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1044.308382] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79226bb0-cd7a-40be-a6ae-6d5edd485868 with Priority: HIGHEST for action port [ 1044.308663] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.308758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.308947] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.309036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.309218] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-79226bb0-cd7a-40be-a6ae-6d5edd485868 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.309311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.309370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.309575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.310012] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79226bb0-cd7a-40be-a6ae-6d5edd485868',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.328448] env[69847]: INFO networking_nsxv3.common.synchronization [None req-0e8efe82-f373-46ae-bb8c-72e5b9cffbe8 None None] Enqueued Resource ID: 432267ac-3f0e-4571-bd3f-8130f99e3af4 with Priority: HIGHEST for action port [ 1044.328448] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432267ac-3f0e-4571-bd3f-8130f99e3af4 with Priority: HIGHEST for action port [ 1044.331784] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-432267ac-3f0e-4571-bd3f-8130f99e3af4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.331784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432267ac-3f0e-4571-bd3f-8130f99e3af4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.331784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432267ac-3f0e-4571-bd3f-8130f99e3af4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.331784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432267ac-3f0e-4571-bd3f-8130f99e3af4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.331784] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432267ac-3f0e-4571-bd3f-8130f99e3af4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.811946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79226bb0-cd7a-40be-a6ae-6d5edd485868 with status ACTIVE [ 1044.814488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.814488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.814488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.814488] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79226bb0-cd7a-40be-a6ae-6d5edd485868 is going to be updated. [ 1044.834699] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 432267ac-3f0e-4571-bd3f-8130f99e3af4 [ 1044.835035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.835268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.835348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.835585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.835676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.835771] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:432267ac-3f0e-4571-bd3f-8130f99e3af4 already deleted. [ 1044.835868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432267ac-3f0e-4571-bd3f-8130f99e3af4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.838380] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.838380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.838380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.838380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.838380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.838380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79226bb0-cd7a-40be-a6ae-6d5edd485868" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.043575] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1045.043575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.043784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.044351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.044459] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.044683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.044683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.045584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.045584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.045584] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.549854] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.056502] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.156544] env[69847]: INFO networking_nsxv3.common.synchronization [req-d3f32dcf-868b-4996-8708-c851f663e408 req-6172b1a6-e08f-41cf-aa15-70c161cabcf7 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_members [ 1046.156544] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGHEST for action security_group_members [ 1046.156843] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.156965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.161035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.161035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.161035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.161035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.161035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.161035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.161035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.161035] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.307028] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8bfa76d8-9496-494a-b519-6e77521ea109 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_rules [ 1046.307693] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_rules [ 1046.308129] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.308349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.308417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.308940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.309586] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.446101] env[69847]: INFO networking_nsxv3.common.synchronization [None req-56001c6e-892d-49d1-b8ac-629df794a3cb tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_rules [ 1046.446609] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_rules [ 1046.446906] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.447011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.558589] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.558821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.558821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.559054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.559212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.559260] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1046.586130] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.586307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.586389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.586636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.586787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.594514] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1046.662826] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.663823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.663823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.663823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.663823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.663823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.664165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.664165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.664244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.664357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.664399] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 is going to be updated. [ 1046.694940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.695122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.695293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.695404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.697394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.709238] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 in Status: IN_PROGRESS for 2s [ 1046.830853] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.830853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.831102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.831155] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.831248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.831365] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e98e92-8284-4e76-b863-496da25fff54 already deleted. [ 1046.831458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.831612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.831775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.831857] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.355493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.355737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.355787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.356045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.356208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.356334] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e98e92-8284-4e76-b863-496da25fff54 already deleted. [ 1047.356427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.604788] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1048.604788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.604788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.605365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.605622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.605748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.605807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.605987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.606090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.606167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.606259] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.607322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.607322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.607446] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.607617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.607617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.607880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.607880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.607979] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.718281] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 in Status: SUCCESS [ 1048.718470] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 deletion is rescheduled due to dependency. [ 1048.718639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.110539] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.110539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.111470] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.613662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.116686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.116859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.116930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.117209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.117301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.117401] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1050.158518] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.158688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.158688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.158917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.159210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.168159] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1050.903849] env[69847]: INFO networking_nsxv3.common.synchronization [req-04807d8a-12bb-4f12-a626-9d706aadda63 req-30536da0-22cc-4a13-a874-7f28e583f68e tempest-ServersTestManualDisk-785297740 tempest-ServersTestManualDisk-785297740-project-member] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_members [ 1050.905404] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGHEST for action security_group_members [ 1050.905907] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.906305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.906305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.906518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.906747] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.906904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.907033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.907263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.907397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.908011] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.080772] env[69847]: INFO networking_nsxv3.common.synchronization [req-d9e8835f-de08-4379-9ca0-4e6213e2f531 req-3eea4349-3ba3-4ce0-9b1f-de836673de12 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1051.081606] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1051.081948] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.082368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.082464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.082743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.082873] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.082999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.083106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.083280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.083398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.083517] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.410644] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.410924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.411009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.411311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.411417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.411671] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.411782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.411846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.412036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.412173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.412312] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 is going to be updated. [ 1051.440973] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.441170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.441170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.445033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.445033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.451499] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 in Status: IN_PROGRESS for 2s [ 1051.516313] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.516313] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.516313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.516313] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.516313] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.516313] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.516313] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.516849] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1051.516849] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.516849] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.538034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.538034] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1051.538034] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.538034] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.538479] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-ded589f2-de7d-488d-ba19-bb97dd67a233 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.538671] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.538803] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.539178] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.539319] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ded589f2-de7d-488d-ba19-bb97dd67a233',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.587413] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.042714] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.042714] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.043192] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.043192] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.043345] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.043474] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port ded589f2-de7d-488d-ba19-bb97dd67a233 not found, creating... [ 1052.043732] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.043891] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.044023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.044313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.044442] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.044730] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.044886] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.045023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.045260] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.045401] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.045545] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: ded589f2-de7d-488d-ba19-bb97dd67a233 is going to be created. [ 1052.065498] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.065756] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.065756] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.065956] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.066910] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.066910] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.091553] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.183095] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.183095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.183095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.183095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.183095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.184137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.184137] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.598667] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.598667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.598667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.598667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.598667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.598667] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1052.623932] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.624470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.624517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.625467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.625467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.634281] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1052.688777] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08043f9f-80db-4591-bf09-4b14d00f17ee: rpc.has_security_group_logging(os_id): False [ 1052.708027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.708027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.708027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.708027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.708622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.708622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.708622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.708622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.708622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.708622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1052.765805] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.765938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.766298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.766298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.766404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.783966] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1052.878028] env[69847]: INFO networking_nsxv3.common.synchronization [req-d9e8835f-de08-4379-9ca0-4e6213e2f531 req-0aa758d9-61a5-4034-92e3-9618762c8aa8 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1052.878224] env[69847]: INFO networking_nsxv3.common.synchronization [req-d9e8835f-de08-4379-9ca0-4e6213e2f531 req-0aa758d9-61a5-4034-92e3-9618762c8aa8 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1052.878360] env[69847]: INFO networking_nsxv3.common.synchronization [req-d9e8835f-de08-4379-9ca0-4e6213e2f531 req-0aa758d9-61a5-4034-92e3-9618762c8aa8 service nova] Enqueued Resource ID: ded589f2-de7d-488d-ba19-bb97dd67a233 with Priority: HIGHEST for action port [ 1052.878592] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1052.878716] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1052.878834] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded589f2-de7d-488d-ba19-bb97dd67a233 with Priority: HIGHEST for action port [ 1052.879801] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.879964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.880159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.880732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.880840] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.882027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.882296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.883084] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ded589f2-de7d-488d-ba19-bb97dd67a233 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.883233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.883300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.883494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.883579] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ded589f2-de7d-488d-ba19-bb97dd67a233',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.390050] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.390050] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ded589f2-de7d-488d-ba19-bb97dd67a233 with status ACTIVE [ 1053.390050] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.390050] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.390050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.390050] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.390947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.390947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.390947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.390947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.390947] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ded589f2-de7d-488d-ba19-bb97dd67a233 is going to be updated. [ 1053.412852] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.413093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.413093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.413435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.413582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.413809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ded589f2-de7d-488d-ba19-bb97dd67a233" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.464159] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 in Status: SUCCESS [ 1053.464412] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 deletion is rescheduled due to dependency. [ 1053.464686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.642584] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1054.643082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.643178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.643410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.643599] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.643717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.643781] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.643952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.644068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.644162] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.799883] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1054.800241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.800506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.800847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.801011] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.147544] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.198178] env[69847]: INFO networking_nsxv3.common.synchronization [req-e1aab8e4-ff0e-429f-ab57-24f6fa1f489f req-82019b49-dad7-447b-93c9-1e52648573de tempest-ImagesTestJSON-1109607872 tempest-ImagesTestJSON-1109607872-project-member] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1055.198765] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGHEST for action security_group_members [ 1055.202237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.202495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.202590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.203316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.207153] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.207153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.207153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.207153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.207153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.207153] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.303493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.303708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.303807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.303942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.304131] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.304273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.304350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.304487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.304584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.304670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.304754] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.367867] env[69847]: INFO networking_nsxv3.common.synchronization [req-736ffe41-0dec-4452-b89d-f9dd99698a9a req-3a98f4e7-a2e0-42d4-b487-39a504a1933a tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1055.368446] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1055.368775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.368909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.368974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.369201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.369378] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.369486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.369527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.369921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.369921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.369921] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.650263] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.668245] env[69847]: INFO networking_nsxv3.common.synchronization [req-736ffe41-0dec-4452-b89d-f9dd99698a9a req-4a5edcc9-81c2-4f01-8641-d5f99f7749ee tempest-ServersTestMultiNic-948105185 tempest-ServersTestMultiNic-948105185-project-member] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1055.668705] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGHEST for action security_group_members [ 1055.669010] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.669664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.708872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.708872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.708872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.709148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.709266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.709497] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.709618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.709686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.709860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.709939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.710038] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be updated. [ 1055.735133] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.735301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.735445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.735610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.735748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.745506] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: IN_PROGRESS for 2s [ 1055.807265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.807398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.872503] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.152731] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.152891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.153069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.153211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.153294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.153420] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1056.179572] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.179825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.179905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.180257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.180510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.188872] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1056.377150] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.880549] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.880862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.880862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.880999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.881104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.881209] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1056.907468] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.907668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.907668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.907873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.908041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.916131] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1057.754855] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe in Status: SUCCESS [ 1057.755051] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe deletion is rescheduled due to dependency. [ 1057.755165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.197682] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1058.198426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.198426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.198426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.198816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.198816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.198816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.198816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.198996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.198996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.199320] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.701882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.702044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.702156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.702502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.702595] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.702691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.702691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.703725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.703725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.703725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.704191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.704191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.704191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.704191] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.784939] env[69847]: INFO networking_nsxv3.common.synchronization [req-f339e47b-1d1b-4bbc-9b9d-aef822c396bb req-5034d594-1cf8-48e5-9071-8d087dd77d0e tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1058.784939] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1058.784939] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.784939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.784939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.785513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.785823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.786085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.786265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.786546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.786838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.787853] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.926082] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1058.927260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.927613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.927687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.927861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.927985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.928059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.928873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.928873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.928873] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.024575] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b1673e1d-5477-4559-8ef9-acbc93e3e1cc None None] Enqueued Resource ID: 1de3df17-5b51-49fd-b52a-3aed1215f82b with Priority: HIGHEST for action port [ 1059.025113] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de3df17-5b51-49fd-b52a-3aed1215f82b with Priority: HIGHEST for action port [ 1059.025439] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1de3df17-5b51-49fd-b52a-3aed1215f82b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.025554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1de3df17-5b51-49fd-b52a-3aed1215f82b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.025620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1de3df17-5b51-49fd-b52a-3aed1215f82b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.025891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1de3df17-5b51-49fd-b52a-3aed1215f82b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.025978] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1de3df17-5b51-49fd-b52a-3aed1215f82b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.153585] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.153585] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.153585] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.153800] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.154087] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.154457] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.154457] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.154928] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.154928] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.154928] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.155092] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.155351] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.156031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.156031] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.156031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.156031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.177161] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.177335] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.177479] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.177658] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.177969] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.178176] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.178388] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.178736] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.178898] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.206820] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 1059.226324] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.226482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.226552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.227029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.227029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.227180] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.227180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.227272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.228021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.228021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.228021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.228021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.228021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.228021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.228021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.228364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.228421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.228458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.228742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.228742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.228819] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1059.287136] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.289017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.289017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.289017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.289017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.291692] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.291808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.291873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.292085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.292216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.292352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.292446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.292504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.292650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.292720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.292799] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 already deleted. [ 1059.292871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.304031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1059.431210] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.431387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.431453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.431666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.431754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.433677] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.433831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.433898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.434233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.434233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.434470] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1059.460319] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.460471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.460913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.460913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.460913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.473487] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1059.529496] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1de3df17-5b51-49fd-b52a-3aed1215f82b [ 1059.529803] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.529934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.529999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.530236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.530321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.530452] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1de3df17-5b51-49fd-b52a-3aed1215f82b already deleted. [ 1059.533021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1de3df17-5b51-49fd-b52a-3aed1215f82b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.681927] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.681927] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.682098] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.682356] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.682558] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.683108] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 not found, creating... [ 1059.683108] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.683313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.683313] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.683513] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.683653] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.683939] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.684110] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.684232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.684477] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.684624] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.684755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 is going to be created. [ 1059.711866] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.711866] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.712042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.712400] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.712805] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.713012] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.971813] env[69847]: INFO networking_nsxv3.common.synchronization [req-9deb7109-adb0-4047-99ed-b94e7ead91f6 req-40239f9d-fc8f-4e7f-890b-15712a879a4b tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1059.974264] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1059.974890] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.975373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.975591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.976205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.976519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.976778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.978028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.978028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.978028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.978028] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.481177] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.488236] env[69847]: INFO networking_nsxv3.common.synchronization [req-f339e47b-1d1b-4bbc-9b9d-aef822c396bb req-d7299742-919f-41c9-9490-82320ffc6e70 service nova] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_rules [ 1060.488236] env[69847]: INFO networking_nsxv3.common.synchronization [req-f339e47b-1d1b-4bbc-9b9d-aef822c396bb req-d7299742-919f-41c9-9490-82320ffc6e70 service nova] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1060.488236] env[69847]: INFO networking_nsxv3.common.synchronization [req-f339e47b-1d1b-4bbc-9b9d-aef822c396bb req-d7299742-919f-41c9-9490-82320ffc6e70 service nova] Enqueued Resource ID: 393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 with Priority: HIGHEST for action port [ 1060.488236] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_rules [ 1060.488236] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1060.488236] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 with Priority: HIGHEST for action port [ 1060.489828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.489828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.493020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.493020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.493020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.493020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.493020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.493927] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.494217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.494430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.494726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.494921] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.984281] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.997539] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.998680] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.998811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.998949] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 with status ACTIVE [ 1060.999122] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.999260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.999353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.999563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.999653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.999823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.999916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.999976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.000136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.000202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.000393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.000484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.000539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.000675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.000738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.000851] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658 is going to be updated. [ 1061.022719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.022860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.022932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.023731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.023880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.024068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-393cd8d3-18dd-4bcd-9eea-8d7f0ee2a658" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.223893] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7d6352ba-babd-473a-bfb8-2ef59716ef2f None None] Enqueued Resource ID: ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb with Priority: HIGHEST for action port [ 1061.224127] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb with Priority: HIGHEST for action port [ 1061.224758] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.224895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.224895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.225732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.225732] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.318519] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1061.318519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.473108] env[69847]: INFO networking_nsxv3.common.synchronization [None req-e1e80ce2-e922-4973-8858-3b16a57cf534 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1061.473984] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1061.476138] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.476268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.476337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.476587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.476670] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.485177] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1061.485493] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee deletion is rescheduled due to dependency. [ 1061.485616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.485963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.486092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.486163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.486359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.486442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.486531] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1061.487856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.488053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.488828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.489016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.489103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.489265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.489348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.489431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.489589] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.489685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.489744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.489885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.490034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.490131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.490190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.490326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.490399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.490474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.490590] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.503347] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.516077] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.516250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.516315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.516493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.516714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.524713] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1061.620261] env[69847]: INFO networking_nsxv3.common.synchronization [None req-92e03937-fb20-4fd2-92fe-e83c06d3f8db tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1061.620859] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1061.621094] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.621197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.727768] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb [ 1061.727944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.728111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.728177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.728394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.728586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.728586] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb already deleted. [ 1061.728690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecbb19d9-69fb-4cb7-be71-8f1eb7c101bb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.996653] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.996842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.996914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.997116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.997209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.997310] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 already deleted. [ 1061.997395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.997624] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08043f9f-80db-4591-bf09-4b14d00f17ee: rpc.has_security_group_logging(os_id): False [ 1062.000285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.000285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.000285] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.007044] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.007346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.007551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.007853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.008075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.008287] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be created. [ 1062.016707] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.016831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.016896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.017091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.017182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.017375] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.017469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.017563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.017685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.018014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.018014] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.018120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.018120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.018245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.019827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.019827] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.019827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.019827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.019827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.019827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.019827] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be updated. [ 1062.032568] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.032705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.032754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.032945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.033313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.040484] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: UNINITIALIZED for 2s [ 1062.076788] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.076933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.077025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.077247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.077393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.097445] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: IN_PROGRESS for 2s [ 1062.519934] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.520276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.520276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.520988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.520988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.520988] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 already deleted. [ 1062.520988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.536979] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1063.538668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.049604] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1064.049892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.050094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.050367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.050590] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.050720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.050798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.052897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.052897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.052897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.052897] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.094115] env[69847]: INFO networking_nsxv3.common.synchronization [req-b7b2f1b0-1470-4274-9b90-17f5dd67658e req-b75069d9-12fe-4984-bb0c-87c19b18ceff tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_members [ 1064.094728] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_members [ 1064.095393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.095393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.095393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.095686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.095686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.095831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.095831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.095996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.096096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096188] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.115987] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08043f9f-80db-4591-bf09-4b14d00f17ee in Status: SUCCESS [ 1064.115987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.536406] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.536787] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.536787] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.537050] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.537353] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.537495] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.537581] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.537791] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.537952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.538337] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.538463] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.538571] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.538685] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.538795] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.538903] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.539130] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.554516] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.554640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.554692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.554858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.555344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.555467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.555527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.555681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.555764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.555847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.556034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.556112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.556161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.556280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.556415] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.556527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.556600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.556726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.556793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.556869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.556951] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.563513] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.564439] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.564439] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.564439] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.564439] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-622c2082-0246-49e0-9975-9ea1c46e8ede taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.564439] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.564953] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.564953] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.564953] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622c2082-0246-49e0-9975-9ea1c46e8ede',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.599586] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.599765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.599765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.599940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.600041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.600239] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.600337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.600399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.600606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.600682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.600717] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e98e92-8284-4e76-b863-496da25fff54 already deleted. [ 1064.600794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.059026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50dc186b-34b2-45b3-89b7-2dfa7346dc41: rpc.has_security_group_logging(os_id): False [ 1065.066980] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.067196] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.067324] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.067603] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.067752] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.067902] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 622c2082-0246-49e0-9975-9ea1c46e8ede not found, creating... [ 1065.068167] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.068326] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.068446] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.068715] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.068876] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.069182] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.069339] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.069459] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.069694] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.069833] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.069972] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 622c2082-0246-49e0-9975-9ea1c46e8ede is going to be created. [ 1065.076965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.076965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.076965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.077156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.077376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.077376] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.077465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.077502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.077643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.077695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.077874] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.077966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.078028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.078170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.078240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.078413] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.078503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.078555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.078691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.078764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.078846] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be created. [ 1065.089261] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.089452] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.089577] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.090213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.090463] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.090679] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.132807] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.132998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.132998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.133161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.133331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.143859] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1066.004980] env[69847]: INFO networking_nsxv3.common.synchronization [req-b7b2f1b0-1470-4274-9b90-17f5dd67658e req-5696166a-8230-4786-aedf-e7f6c1d3c449 service nova] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_rules [ 1066.005275] env[69847]: INFO networking_nsxv3.common.synchronization [req-b7b2f1b0-1470-4274-9b90-17f5dd67658e req-5696166a-8230-4786-aedf-e7f6c1d3c449 service nova] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_members [ 1066.005328] env[69847]: INFO networking_nsxv3.common.synchronization [req-b7b2f1b0-1470-4274-9b90-17f5dd67658e req-5696166a-8230-4786-aedf-e7f6c1d3c449 service nova] Enqueued Resource ID: 622c2082-0246-49e0-9975-9ea1c46e8ede with Priority: HIGHEST for action port [ 1066.005886] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_rules [ 1066.005974] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_members [ 1066.006180] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622c2082-0246-49e0-9975-9ea1c46e8ede with Priority: HIGHEST for action port [ 1066.006499] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.006706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.006706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.006947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.007012] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.008278] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.008386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.008475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.008693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.008839] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.008953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.009046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.009212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.009297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.009385] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.010661] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-622c2082-0246-49e0-9975-9ea1c46e8ede taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.010795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.010863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.011028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.011120] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622c2082-0246-49e0-9975-9ea1c46e8ede',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.508959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.509097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.511488] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.515456] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 622c2082-0246-49e0-9975-9ea1c46e8ede with status ACTIVE [ 1066.516145] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.516309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.516394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.517366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.517366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.517492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.517667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.517770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.518254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.519132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.519471] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.519471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.519564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.519631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.519725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.519836] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 622c2082-0246-49e0-9975-9ea1c46e8ede is going to be updated. [ 1066.541068] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.541279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.541279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.541473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.541797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.541930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-622c2082-0246-49e0-9975-9ea1c46e8ede" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.770998] env[69847]: INFO networking_nsxv3.common.synchronization [req-cde4eff0-789e-48a0-9386-2f54f214db45 req-2bd869c4-e9b4-46ac-a71d-be369d06f2b3 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1066.771692] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1066.771850] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.771970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.773603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.773862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.777178] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.777285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.777350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.777527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.777613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.777706] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.016917] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.156434] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1067.156434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.279463] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.522821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.522972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.523088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.523494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.523494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.523494] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e98e92-8284-4e76-b863-496da25fff54 is going to be created. [ 1067.546385] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.546596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.546754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.547289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.547289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.556044] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: UNINITIALIZED for 2s [ 1067.784825] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.287106] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.287434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.287434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.287574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.287729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.287814] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1068.315955] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.316110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.316260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.316397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.316527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.324824] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1069.569592] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: SUCCESS [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.569592] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.569592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.569592] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.787555] env[69847]: INFO networking_nsxv3.common.synchronization [None req-070ab13d-d3dc-46d3-9cbe-fa45727bc7f8 None None] Enqueued Resource ID: 9b811b0b-fdaf-4d6b-ae47-603c4e4d3699 with Priority: HIGHEST for action port [ 1069.787827] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b811b0b-fdaf-4d6b-ae47-603c4e4d3699 with Priority: HIGHEST for action port [ 1069.788457] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b811b0b-fdaf-4d6b-ae47-603c4e4d3699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.788555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b811b0b-fdaf-4d6b-ae47-603c4e4d3699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.788694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b811b0b-fdaf-4d6b-ae47-603c4e4d3699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.788887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b811b0b-fdaf-4d6b-ae47-603c4e4d3699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.788972] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b811b0b-fdaf-4d6b-ae47-603c4e4d3699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.071454] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.291838] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b811b0b-fdaf-4d6b-ae47-603c4e4d3699 [ 1070.292042] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.292179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.292282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.292486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.292579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.292693] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b811b0b-fdaf-4d6b-ae47-603c4e4d3699 already deleted. [ 1070.292775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b811b0b-fdaf-4d6b-ae47-603c4e4d3699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.338354] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1070.338354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.581769] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90e98e92-8284-4e76-b863-496da25fff54: rpc.has_security_group_logging(os_id): False [ 1070.600128] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.602039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.602039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.602344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.602344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.602506] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.602628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.602697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.602902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.602970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.603090] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e98e92-8284-4e76-b863-496da25fff54 is going to be created. [ 1070.664500] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.664500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.664617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.664925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.664925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.678155] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: IN_PROGRESS for 2s [ 1072.292527] env[69847]: INFO networking_nsxv3.common.synchronization [None req-50f8a750-d44c-4182-b2af-133f74d78e12 None None] Enqueued Resource ID: 4f8f1d50-fde7-417f-87e0-fcd85a8b976c with Priority: HIGHEST for action port [ 1072.293185] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f8f1d50-fde7-417f-87e0-fcd85a8b976c with Priority: HIGHEST for action port [ 1072.293866] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f8f1d50-fde7-417f-87e0-fcd85a8b976c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.293866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f8f1d50-fde7-417f-87e0-fcd85a8b976c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.293866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f8f1d50-fde7-417f-87e0-fcd85a8b976c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.294069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f8f1d50-fde7-417f-87e0-fcd85a8b976c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.294069] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f8f1d50-fde7-417f-87e0-fcd85a8b976c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.635410] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c59dd75-32b9-4cd0-8125-1a838cf38722 req-7cce3fc1-4ef9-4d34-b694-1143507c180b tempest-ServersV294TestFqdnHostnames-2038459689 tempest-ServersV294TestFqdnHostnames-2038459689-project-member] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_members [ 1072.635635] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGHEST for action security_group_members [ 1072.636055] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.636141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.636191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.636789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.636789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.636789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.636789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.636789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.637434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.637434] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.691046] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: SUCCESS [ 1072.691302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.797146] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f8f1d50-fde7-417f-87e0-fcd85a8b976c [ 1072.797465] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.797656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.797725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.797936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.798572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.798572] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f8f1d50-fde7-417f-87e0-fcd85a8b976c already deleted. [ 1072.798572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f8f1d50-fde7-417f-87e0-fcd85a8b976c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.139722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.139873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.139935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.140172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.140273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.140960] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.140960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.140960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.140960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.140960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.140960] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb is going to be updated. [ 1073.168191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.168374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.168566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.168687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.168887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.177424] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb in Status: IN_PROGRESS for 2s [ 1074.834238] env[69847]: INFO networking_nsxv3.common.synchronization [None req-26c9712c-505b-4064-9550-83a65f5975d6 None None] Enqueued Resource ID: 73d4a9c7-6e47-48d2-99ad-54238bf67f6d with Priority: HIGHEST for action port [ 1074.834555] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73d4a9c7-6e47-48d2-99ad-54238bf67f6d with Priority: HIGHEST for action port [ 1074.835045] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-73d4a9c7-6e47-48d2-99ad-54238bf67f6d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.835173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73d4a9c7-6e47-48d2-99ad-54238bf67f6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.835238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73d4a9c7-6e47-48d2-99ad-54238bf67f6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.835523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73d4a9c7-6e47-48d2-99ad-54238bf67f6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.835621] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73d4a9c7-6e47-48d2-99ad-54238bf67f6d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.188147] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb in Status: SUCCESS [ 1075.188374] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb deletion is rescheduled due to dependency. [ 1075.188506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.339617] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73d4a9c7-6e47-48d2-99ad-54238bf67f6d [ 1075.339617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.339617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.339617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.339617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.339617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.339617] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73d4a9c7-6e47-48d2-99ad-54238bf67f6d already deleted. [ 1075.339617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73d4a9c7-6e47-48d2-99ad-54238bf67f6d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.957803] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8b2fc18a-f5bd-4e42-94a6-a6aa74952a27 None None] Enqueued Resource ID: 0bbc1e48-62d5-4720-b11e-97dd36d6a0a5 with Priority: HIGHEST for action port [ 1076.957803] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bbc1e48-62d5-4720-b11e-97dd36d6a0a5 with Priority: HIGHEST for action port [ 1076.957803] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bbc1e48-62d5-4720-b11e-97dd36d6a0a5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.957803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bbc1e48-62d5-4720-b11e-97dd36d6a0a5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.957803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bbc1e48-62d5-4720-b11e-97dd36d6a0a5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.959324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bbc1e48-62d5-4720-b11e-97dd36d6a0a5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.959324] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bbc1e48-62d5-4720-b11e-97dd36d6a0a5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.459735] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bbc1e48-62d5-4720-b11e-97dd36d6a0a5 [ 1077.459966] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.460100] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.460167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.460371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.460456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.460549] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bbc1e48-62d5-4720-b11e-97dd36d6a0a5 already deleted. [ 1077.460636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bbc1e48-62d5-4720-b11e-97dd36d6a0a5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.538384] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5f05715-8e5e-4915-86c9-f02499f2fd17 req-706edee0-a4c6-4cb0-9dc2-7fed0916c2c1 tempest-InstanceActionsNegativeTestJSON-2037191188 tempest-InstanceActionsNegativeTestJSON-2037191188-project-member] Enqueued Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_members [ 1078.538994] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_members [ 1078.539282] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.539406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.539486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.540366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.540366] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.540366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.540366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.540366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.540366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.540366] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.919686] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-148 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.919686] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-148" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.919686] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-148" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.919686] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-148" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.919686] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.920024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.920024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.920163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.920312] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.920524] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.920642] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.920746] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.920855] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.920963] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.921082] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.921212] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.939274] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.939428] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.939567] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.939748] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-148" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.940237] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.940519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.940743] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.941214] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.941437] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a6398e0-4ea4-4381-b178-90d8b2fad0e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.042375] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.042537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.042604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.042824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.042914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.043127] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.043215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.043275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.043422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.043496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.043584] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07375a76-81ac-4415-b226-523a25ff6c62 already deleted. [ 1079.043664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.376114] env[69847]: INFO networking_nsxv3.common.synchronization [req-75314133-8615-491b-9218-d04230f77049 req-9969a519-1586-49ba-aa21-99909517a786 tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1079.376640] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1079.377014] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.378168] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.378168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.378168] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.445008] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.445223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.445328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.445688] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.445886] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.446087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 9a6398e0-4ea4-4381-b178-90d8b2fad0e2 not found, creating... [ 1079.446383] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.446597] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.446749] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.447052] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.447237] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.447551] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.447762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.447934] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.448206] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.448383] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.448554] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 9a6398e0-4ea4-4381-b178-90d8b2fad0e2 is going to be created. [ 1079.466302] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.466482] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.466649] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.466860] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.467058] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.467272] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.880507] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.880842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.880842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.880951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.881054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.881296] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.881361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.881399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.881552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.881633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.881725] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1079.906370] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.906370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.906574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.907239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.907239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.914869] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1080.314890] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5f05715-8e5e-4915-86c9-f02499f2fd17 req-1844b735-b360-4d24-9922-aa99ea926b2f service nova] Enqueued Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_rules [ 1080.314890] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5f05715-8e5e-4915-86c9-f02499f2fd17 req-1844b735-b360-4d24-9922-aa99ea926b2f service nova] Enqueued Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_members [ 1080.314890] env[69847]: INFO networking_nsxv3.common.synchronization [req-b5f05715-8e5e-4915-86c9-f02499f2fd17 req-1844b735-b360-4d24-9922-aa99ea926b2f service nova] Enqueued Resource ID: 9a6398e0-4ea4-4381-b178-90d8b2fad0e2 with Priority: HIGHEST for action port [ 1080.314890] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_rules [ 1080.315487] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_members [ 1080.315487] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a6398e0-4ea4-4381-b178-90d8b2fad0e2 with Priority: HIGHEST for action port [ 1080.315959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.316078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.316246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.316425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.316508] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.318051] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.318207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.318207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.318347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.318493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.318645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.318645] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.318784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.318861] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.318996] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.319857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.319969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.320064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.320152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.320402] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a6398e0-4ea4-4381-b178-90d8b2fad0e2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.822032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.822032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.822032] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.822828] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a6398e0-4ea4-4381-b178-90d8b2fad0e2 with status ACTIVE [ 1080.823109] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.823216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.823311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.823540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.823658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.823856] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.824108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.824108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.824318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.824442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.824721] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.824885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.825101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.825238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.825364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.825508] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a6398e0-4ea4-4381-b178-90d8b2fad0e2 is going to be updated. [ 1080.845605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.845828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.845939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.846235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.846432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.846650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a6398e0-4ea4-4381-b178-90d8b2fad0e2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.327496] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.829988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.830274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.830274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.830552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.830672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.830833] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07375a76-81ac-4415-b226-523a25ff6c62 is going to be created. [ 1081.858782] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.859015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.859015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.859247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.859400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.869588] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07375a76-81ac-4415-b226-523a25ff6c62 in Status: UNINITIALIZED for 2s [ 1081.930398] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1081.930588] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 deletion is rescheduled due to dependency. [ 1081.930701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.478475] env[69847]: INFO networking_nsxv3.common.synchronization [req-a45d2ffe-516b-49b9-96c0-ac771f7da5ea req-2aab3d66-2974-45c6-b472-8caff28eee3c tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1082.479049] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1082.479424] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.479565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.479635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.479851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.480030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.480168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.480244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.480408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.480509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.480616] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.984376] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.984561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.984636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.984866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.005107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.005614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.005614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.005614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.005816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.005816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.005897] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1083.055249] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.055390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.055839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.055839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.055839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.068084] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1083.880904] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07375a76-81ac-4415-b226-523a25ff6c62 in Status: SUCCESS [ 1083.881210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.881301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.881511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.881702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.881815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.881872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.882036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.882976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.882976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.882976] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.053937] env[69847]: INFO networking_nsxv3.common.synchronization [req-3cf425e0-312b-46c0-a211-4b2279770e5a req-ae0449e4-ec3b-4df8-82e4-8ac8990bc769 tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_members [ 1084.053937] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGHEST for action security_group_members [ 1084.053937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.053937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.054846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.054846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.054846] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.054846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.054846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.054846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.054846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.054846] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.385407] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.385602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.385701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.385933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.386575] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.386711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.386711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.386849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.386981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.387092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.387255] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.387346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.387405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.387551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.387713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.387808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.387865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.388083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.388083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.388178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.388227] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.558045] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.558045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.558045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.558045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.580462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.580692] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.580829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.580984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.581093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.581168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.581297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 is going to be updated. [ 1084.605327] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.605327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.605327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.605589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.605627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.617414] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: IN_PROGRESS for 2s [ 1084.892289] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07375a76-81ac-4415-b226-523a25ff6c62: rpc.has_security_group_logging(os_id): False [ 1084.908935] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.909090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.909149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.909364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.909450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.909657] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.909729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.909791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.909944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.910031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.910225] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.910332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.910376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.910748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.910835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.911043] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.911141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.911200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.911344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.911418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.911512] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07375a76-81ac-4415-b226-523a25ff6c62 is going to be created. [ 1084.972376] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.972687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.972777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.973020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.973216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.983493] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07375a76-81ac-4415-b226-523a25ff6c62 in Status: IN_PROGRESS for 2s [ 1085.083843] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1085.084041] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f deletion is rescheduled due to dependency. [ 1085.084157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.420723] env[69847]: INFO networking_nsxv3.common.synchronization [req-d5fe9bcf-bc5f-4d62-9bff-bf773611bea4 req-f8f9daaa-021a-4b2b-8bbf-0005546bd636 tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1085.421276] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1085.421586] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.421720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.421778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.421970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.422700] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.422700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.422700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.422700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.422700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.422700] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.927081] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.429489] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.627797] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 in Status: SUCCESS [ 1086.627988] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 deletion is rescheduled due to dependency. [ 1086.628118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.931953] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.932387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.932387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.932686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.932845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.933120] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1086.967052] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.967296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.967296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.967569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.967768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.976873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1086.993105] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07375a76-81ac-4415-b226-523a25ff6c62 in Status: SUCCESS [ 1086.993382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.986021] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1088.986295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.469371] env[69847]: INFO networking_nsxv3.common.synchronization [req-9d41f48a-8a5e-4242-bcbd-5d3660b43092 req-f8fe0a24-ba27-4ff8-a41d-9167c40b5d09 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1089.469960] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1089.470333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.470472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.470553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.470831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.471072] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.471174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.471253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.471415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.471517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.471621] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.866658] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.866855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.866990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.867419] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.867689] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.867848] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.867964] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.868201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.868368] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.868600] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.868719] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.868836] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.868950] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.869083] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.869216] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.869326] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.887691] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.887878] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.888020] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.888198] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.888499] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-4497f6a1-3ba5-44ee-bcd5-48418075139a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.889013] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.889013] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.889139] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.889284] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4497f6a1-3ba5-44ee-bcd5-48418075139a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.973899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.974131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.974131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.974352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.974441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.974714] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.974815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.974883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.975132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.975258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.975399] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 already deleted. [ 1089.975514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.391957] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.392349] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.392479] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.392790] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.392957] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.393245] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 4497f6a1-3ba5-44ee-bcd5-48418075139a not found, creating... [ 1090.393535] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.393723] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.393918] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.394260] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.394389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.394879] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.395069] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.395196] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.395416] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.395640] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.395868] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 4497f6a1-3ba5-44ee-bcd5-48418075139a is going to be created. [ 1090.415975] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.416247] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.416367] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.416750] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.417116] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.417416] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.835219] env[69847]: INFO networking_nsxv3.common.synchronization [req-68338ed3-0f2c-46a3-97e8-a15cbc18bad9 req-8912ab9c-13c2-4119-9389-1f8896178a38 tempest-InstanceActionsNegativeTestJSON-2037191188 tempest-InstanceActionsNegativeTestJSON-2037191188-project-member] Enqueued Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_members [ 1090.835219] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGHEST for action security_group_members [ 1090.835333] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.835387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.835530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.835696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.835851] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.835946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.836013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.836187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.836312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.836370] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.163036] env[69847]: INFO networking_nsxv3.common.synchronization [req-9d41f48a-8a5e-4242-bcbd-5d3660b43092 req-5128d023-7eb2-49f2-911a-f6d68e4fa930 service nova] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1091.163036] env[69847]: INFO networking_nsxv3.common.synchronization [req-9d41f48a-8a5e-4242-bcbd-5d3660b43092 req-5128d023-7eb2-49f2-911a-f6d68e4fa930 service nova] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1091.163036] env[69847]: INFO networking_nsxv3.common.synchronization [req-9d41f48a-8a5e-4242-bcbd-5d3660b43092 req-5128d023-7eb2-49f2-911a-f6d68e4fa930 service nova] Enqueued Resource ID: 4497f6a1-3ba5-44ee-bcd5-48418075139a with Priority: HIGHEST for action port [ 1091.163036] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1091.163036] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1091.163036] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4497f6a1-3ba5-44ee-bcd5-48418075139a with Priority: HIGHEST for action port [ 1091.163036] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.163036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.163036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.164469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.164827] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.166844] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.167108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.167192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.167429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.167611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.167785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.167852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.168036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.168126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.168227] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.169345] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4497f6a1-3ba5-44ee-bcd5-48418075139a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.169483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.169483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.169622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.169705] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4497f6a1-3ba5-44ee-bcd5-48418075139a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.366552] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.366552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.366552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.366552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.366552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.366552] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.366552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.369309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.369579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.369695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.369829] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07375a76-81ac-4415-b226-523a25ff6c62 is going to be updated. [ 1091.401017] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.401017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.401017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.401017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.401017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.411904] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07375a76-81ac-4415-b226-523a25ff6c62 in Status: IN_PROGRESS for 2s [ 1091.673313] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.673313] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.673313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.673527] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4497f6a1-3ba5-44ee-bcd5-48418075139a with status ACTIVE [ 1091.673527] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.673635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.673691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.673894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.673982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.674161] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.674255] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.675111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.675111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.675111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.675111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.675111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.675111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.676503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.676621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.676722] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4497f6a1-3ba5-44ee-bcd5-48418075139a is going to be updated. [ 1091.698437] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.698437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.698437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.698437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.698437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.698437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4497f6a1-3ba5-44ee-bcd5-48418075139a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.849071] env[69847]: INFO networking_nsxv3.common.synchronization [req-c41675fd-8ced-463a-8c42-f94740278a42 req-655e482f-ed31-4ab2-b407-5f3586bba189 tempest-ServerRescueTestJSON-1705482383 tempest-ServerRescueTestJSON-1705482383-project-member] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1091.849606] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1091.849909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.850054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.850131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.850390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.850555] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.850657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.850720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.850871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.850972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.852108] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.182405] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.262851] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.262851] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.263409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.266042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.266042] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.266042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.266042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.266042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.266042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.266042] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.266460] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.266460] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.266460] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.266573] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.266612] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.267682] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.285130] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.285302] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1092.285458] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.285672] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.286011] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-22b8125e-bd54-40bd-a62c-afd873d2906b taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.286675] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.286675] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.286770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.287325] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22b8125e-bd54-40bd-a62c-afd873d2906b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.353238] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.353454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.353533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.353828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.353889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.354126] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.354247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.354313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.354499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.354630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.354726] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 already deleted. [ 1092.354830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.685041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.685041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.685041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.685041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.685041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.685812] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be created. [ 1092.710719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.710935] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.711026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.711276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.711467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.720975] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: UNINITIALIZED for 2s [ 1092.789869] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.790017] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.790077] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.790381] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.790542] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.790731] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 22b8125e-bd54-40bd-a62c-afd873d2906b not found, creating... [ 1092.790956] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.791136] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.791256] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.791481] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.791650] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.791925] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.792153] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.792307] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.792580] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.792788] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.792950] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 22b8125e-bd54-40bd-a62c-afd873d2906b is going to be created. [ 1092.813423] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.813763] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.814202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.814647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.814945] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.815286] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.975556] env[69847]: INFO networking_nsxv3.common.synchronization [req-f8cb10bb-e565-4b0a-be4c-cd58e84b7a14 req-f0627f23-d359-458a-9d5d-ac14d2d65dfd tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1092.976107] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1092.976398] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.976526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.976597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.976853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.976944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.977194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.977289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.977481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.977597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.977730] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.422520] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07375a76-81ac-4415-b226-523a25ff6c62 in Status: SUCCESS [ 1093.422742] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07375a76-81ac-4415-b226-523a25ff6c62 deletion is rescheduled due to dependency. [ 1093.422816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.480453] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.562213] env[69847]: INFO networking_nsxv3.common.synchronization [req-c41675fd-8ced-463a-8c42-f94740278a42 req-40710f53-c86f-48fb-9b26-434164303ced service nova] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_rules [ 1093.562213] env[69847]: INFO networking_nsxv3.common.synchronization [req-c41675fd-8ced-463a-8c42-f94740278a42 req-40710f53-c86f-48fb-9b26-434164303ced service nova] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1093.562213] env[69847]: INFO networking_nsxv3.common.synchronization [req-c41675fd-8ced-463a-8c42-f94740278a42 req-40710f53-c86f-48fb-9b26-434164303ced service nova] Enqueued Resource ID: 22b8125e-bd54-40bd-a62c-afd873d2906b with Priority: HIGHEST for action port [ 1093.562213] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_rules [ 1093.562213] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1093.562213] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b8125e-bd54-40bd-a62c-afd873d2906b with Priority: HIGHEST for action port [ 1093.562213] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.562213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.562213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.563396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.563396] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.564212] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.564212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.564212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.564212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.564424] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.564501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.564577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.564780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.564912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.565142] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.566049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-22b8125e-bd54-40bd-a62c-afd873d2906b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.566186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.566278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.566456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.566561] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22b8125e-bd54-40bd-a62c-afd873d2906b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.984433] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.070155] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.070339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.070508] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.075020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22b8125e-bd54-40bd-a62c-afd873d2906b with status ACTIVE [ 1094.075020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.075020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.075020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.075020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.075020] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22b8125e-bd54-40bd-a62c-afd873d2906b is going to be updated. [ 1094.099020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.099020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.099020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.099020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.099020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.099020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22b8125e-bd54-40bd-a62c-afd873d2906b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.333781] env[69847]: INFO networking_nsxv3.common.synchronization [req-ff66cbf4-12b2-493b-a73f-1b8617ec189d req-8c58e32c-1dcf-4e48-8dc8-a77b617c48d2 tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1094.334295] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1094.334606] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.334760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.334840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.336366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.336447] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.336560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.336655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.336808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.336894] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.337580] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.487519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.487519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.487519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.487749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.487749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.487815] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1094.517216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.517372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.517430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.517651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.517761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.526120] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1094.540925] env[69847]: INFO networking_nsxv3.common.synchronization [None req-f14bc8b1-0c67-4486-8674-4b8dbe771f59 tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c with Priority: HIGHEST for action security_group_rules [ 1094.541433] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c with Priority: HIGHEST for action security_group_rules [ 1094.541728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.541850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.541907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.542172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.542253] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.577021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.680910] env[69847]: INFO networking_nsxv3.common.synchronization [None req-339b2fb6-9da9-4cf9-a559-1647b23c4ee4 tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c with Priority: HIGHEST for action security_group_rules [ 1094.681471] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c with Priority: HIGHEST for action security_group_rules [ 1094.681729] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.681850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.730199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1094.730381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.730529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.730777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.730925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.731051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.731115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.731259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.731338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.731432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.731504] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.842222] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.842371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.843141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.843838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.843838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.843838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.844013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.844013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.844130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.844206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.844292] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c already deleted. [ 1094.844972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.014018] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.014018] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.014018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.014018] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.014018] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.014018] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.014018] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.014810] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.014810] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.014810] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.032915] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.033127] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1095.033233] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.033412] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.033721] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.033929] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.034081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.034409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.034550] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05a8ba0-346f-4bb1-ae1a-f9c1dab42971',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.060348] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.060540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.060614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.060765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.060852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.060949] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c already deleted. [ 1095.061039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.061400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.061576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.061649] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.079894] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.080035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.080137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.080276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.080360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.080451] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be created. [ 1095.101347] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.101485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.101549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.101748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.102029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.112069] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: UNINITIALIZED for 2s [ 1095.233912] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.537486] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.537722] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.537858] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.538194] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.538355] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.538518] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 not found, creating... [ 1095.538784] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.538950] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.539089] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.539324] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.539467] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.539752] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.539952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.540042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.540260] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.540400] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.540544] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 is going to be created. [ 1095.560358] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.560358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.560358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.560358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.560358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.560358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.579747] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.579840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.579941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.580229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.580313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.580443] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c already deleted. [ 1095.580557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd12e7c-fcd6-4a23-95b2-b1be2e679f6c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.736380] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf911be5-2488-4f40-9c8d-53a9a8a05396: rpc.has_security_group_logging(os_id): False [ 1095.753155] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.753564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.753700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.754815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.754815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.754815] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.754815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.754815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.754815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.754815] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.754815] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be created. [ 1095.812757] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.812898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.812985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.813212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.813388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.822926] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: IN_PROGRESS for 2s [ 1096.311433] env[69847]: INFO networking_nsxv3.common.synchronization [req-ff66cbf4-12b2-493b-a73f-1b8617ec189d req-1ee3b32b-06e3-4339-94bb-6b4b623a3d0c service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1096.311433] env[69847]: INFO networking_nsxv3.common.synchronization [req-ff66cbf4-12b2-493b-a73f-1b8617ec189d req-1ee3b32b-06e3-4339-94bb-6b4b623a3d0c service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1096.311433] env[69847]: INFO networking_nsxv3.common.synchronization [req-ff66cbf4-12b2-493b-a73f-1b8617ec189d req-1ee3b32b-06e3-4339-94bb-6b4b623a3d0c service nova] Enqueued Resource ID: f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 with Priority: HIGHEST for action port [ 1096.311433] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1096.311433] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1096.311433] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 with Priority: HIGHEST for action port [ 1096.311433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.311433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.311433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.311955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.311955] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.312655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.312827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.312895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.313231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.313503] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.313664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.313854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.316034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.316034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.316034] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.316034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.316034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.316034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.316034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.316034] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f05a8ba0-346f-4bb1-ae1a-f9c1dab42971',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.535860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1096.536090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.817547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.817855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.817855] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.818734] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 with status ACTIVE [ 1096.818921] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.819047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.819448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.819448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.819448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.819649] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.819718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.819718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.819868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.819944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.821034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.821034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.821034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.821034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.821034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.821034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f05a8ba0-346f-4bb1-ae1a-f9c1dab42971 is going to be updated. [ 1096.852440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.852440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.852440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.852841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.852941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.853194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f05a8ba0-346f-4bb1-ae1a-f9c1dab42971" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.121401] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: UNINITIALIZED for 4s [ 1097.322919] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.825316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.825316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.825316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.825546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.825546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.825649] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be created. [ 1097.836247] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1097.836453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.848777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.848908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.848984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.849176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.849328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.857494] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: UNINITIALIZED for 2s [ 1098.866226] env[69847]: INFO networking_nsxv3.common.synchronization [None req-c98220ca-2fbd-4dc0-82cd-f5a08ec56d39 tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_rules [ 1098.866846] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_rules [ 1098.868865] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.869009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.869108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.869404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.869490] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.002953] env[69847]: INFO networking_nsxv3.common.synchronization [None req-69513691-f361-4f96-a2e8-bfef3e5097c4 tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_rules [ 1099.003503] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_rules [ 1099.003624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.003729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.130186] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1099.130397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.130552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.130766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.130963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.131068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.131128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.131274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.131350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.131432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.131518] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.392314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.392490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.392566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.392822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.392927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.393058] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 already deleted. [ 1099.393162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.393334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.393461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.393567] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.629297] env[69847]: INFO networking_nsxv3.common.synchronization [req-5e5424ca-214f-4f51-876e-2fcafc62a2d8 req-7d6d37bb-26d4-4e57-8fd8-05db32cc5ea3 tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_members [ 1099.629955] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGHEST for action security_group_members [ 1099.630211] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.630347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.630426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.630649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.630820] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.631196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.631337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.631588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.631745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.631913] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.633187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.633336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.633396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.633552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.633747] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.633873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.633956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.634314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.634314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.634314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.634497] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.634612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.634739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.634879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.635059] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.635154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.635215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.635401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.635570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.635619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.635732] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.866970] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1099.867322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.867373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.867585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.867756] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.867860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.867922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.868076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.868149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.868228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.868314] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.912997] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.913372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.913461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.913747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.913976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.914038] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 already deleted. [ 1099.914136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.133657] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.133895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.133982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.134296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.134457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.135241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.135241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.135380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.135489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.135568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.135683] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 is going to be updated. [ 1100.137071] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 777d5afe-018d-46de-82b7-4dde124236a9: rpc.has_security_group_logging(os_id): False [ 1100.158127] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.158310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.158411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.159404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.159404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.159404] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.159404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.159404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.159640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.159667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.159896] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.160008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.160114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.160783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.160903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.161164] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.161300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.161368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.161613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.161734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.161839] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be created. [ 1100.166901] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.167445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.167445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.167445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.167696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.178606] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c523ece5-b863-4da0-bab3-ae503f8fa633 in Status: IN_PROGRESS for 2s [ 1100.226213] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.226361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.226465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.226659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.226858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.238187] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: IN_PROGRESS for 2s [ 1100.372067] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.372067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.372067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.372067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.372280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.372280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.372358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.372488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.372575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.375101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.375101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.375101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.375101] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.878136] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa82bf-be1b-4e2a-9d96-94b63738ba8c: rpc.has_security_group_logging(os_id): False [ 1100.896884] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.897128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.897213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.897430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.897521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.897775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.897921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.898013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.898169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.898248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.898430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.898525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.898586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.898728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.898803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.898982] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.899086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.899146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.899285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.899373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.899494] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be created. [ 1100.954991] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.955269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.955414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.955737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.955997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.966387] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1102.187402] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c523ece5-b863-4da0-bab3-ae503f8fa633 in Status: SUCCESS [ 1102.187402] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 deletion is rescheduled due to dependency. [ 1102.187402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.251779] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1102.251779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.912832] env[69847]: INFO networking_nsxv3.common.synchronization [req-23d27444-d37b-49e7-88b1-ccc87d5bf698 req-406b737b-fcb3-4e81-b18c-fc8cedfc2da6 tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1102.914943] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1102.914943] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.914943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.914943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.915217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.915217] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.915419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.915419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.917857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.917857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.917857] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.977456] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1102.977700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.419063] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.921033] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.423067] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.423441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.423441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.423503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.423727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.423727] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1104.451201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.451363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.451446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.451901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.451901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.460104] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1106.471183] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1106.471524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.506989] env[69847]: INFO networking_nsxv3.common.synchronization [req-1dbee70b-a96e-4029-9998-2d151c5aa8d3 req-a897f340-dd13-46d1-9369-a6b8834dd25a tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1106.508026] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1106.508273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.508433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.508526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.508855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.509161] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.509302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.509390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.509575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.509690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.509810] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.848023] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.848318] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.849041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.849126] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.849451] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.849678] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.849868] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.850207] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.850427] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.850728] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.850923] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.851136] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.851325] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.851518] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.851700] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.851914] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.880356] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.880620] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.880859] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.881157] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.881558] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-d0d5880a-3975-46b4-bf75-9e4cf4de8272 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.881759] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.881962] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.882329] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.882480] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0d5880a-3975-46b4-bf75-9e4cf4de8272',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.012341] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.012508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.012572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.012813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.012905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.013146] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.013261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.013327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.013500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.013589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.013679] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1107.051056] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.051299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.051417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.051761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.052069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.063328] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1107.385149] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.385372] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.385747] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.386084] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.386254] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.386415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port d0d5880a-3975-46b4-bf75-9e4cf4de8272 not found, creating... [ 1107.386683] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.386852] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.386973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.387217] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.387358] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.387670] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.388013] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.388145] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.388361] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.388499] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.388640] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: d0d5880a-3975-46b4-bf75-9e4cf4de8272 is going to be created. [ 1107.408059] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.408059] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.408331] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.408450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.408701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.408924] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.124176] env[69847]: INFO networking_nsxv3.common.synchronization [req-1dbee70b-a96e-4029-9998-2d151c5aa8d3 req-600b0765-d6e4-442d-8fdb-7906664b9ad4 service nova] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_rules [ 1108.124409] env[69847]: INFO networking_nsxv3.common.synchronization [req-1dbee70b-a96e-4029-9998-2d151c5aa8d3 req-600b0765-d6e4-442d-8fdb-7906664b9ad4 service nova] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1108.124505] env[69847]: INFO networking_nsxv3.common.synchronization [req-1dbee70b-a96e-4029-9998-2d151c5aa8d3 req-600b0765-d6e4-442d-8fdb-7906664b9ad4 service nova] Enqueued Resource ID: d0d5880a-3975-46b4-bf75-9e4cf4de8272 with Priority: HIGHEST for action port [ 1108.124799] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_rules [ 1108.124936] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1108.125047] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0d5880a-3975-46b4-bf75-9e4cf4de8272 with Priority: HIGHEST for action port [ 1108.125752] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.125928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.126085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.126353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.126446] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.128527] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.128675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.128900] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0d5880a-3975-46b4-bf75-9e4cf4de8272 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.129016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.129084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.129263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.129343] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0d5880a-3975-46b4-bf75-9e4cf4de8272',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.586572] env[69847]: INFO networking_nsxv3.common.synchronization [req-c4df4704-c7b7-4dd6-979e-824062dd373a req-d20a57a6-6ff9-461b-a4b2-3c75e011b649 tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1108.587088] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1108.587387] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.587506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.587571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.587763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.587922] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.588017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.588113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.588232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.588313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.588400] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.631422] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.631560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.631715] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0d5880a-3975-46b4-bf75-9e4cf4de8272 with status ACTIVE [ 1108.631880] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.631985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.632063] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.632270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.632359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.632527] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.632630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.632676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.632834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.632911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.633103] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.633198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.633247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.633387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.633597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.633597] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0d5880a-3975-46b4-bf75-9e4cf4de8272 is going to be updated. [ 1108.654054] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.654189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.654259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.654677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.654677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.654772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0d5880a-3975-46b4-bf75-9e4cf4de8272" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.072934] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1109.073193] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 deletion is rescheduled due to dependency. [ 1109.073367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.073571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.073828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.074076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.074244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.074349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.074577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.074701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.074899] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.090199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.090305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.090376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.090783] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.090879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.090938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.091090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.091165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.091247] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1109.115142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.115247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.115305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.115461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.115586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.125446] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1109.577390] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.079783] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.582255] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.582611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.582611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.582810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.582810] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.582877] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1110.608554] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.608703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.608773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.608971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.609131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.617124] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1111.135763] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1111.135939] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1111.136083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.332811] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1111.332939] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1112.141394] env[69847]: INFO networking_nsxv3.common.synchronization [req-c5f35cee-2f4f-4b65-8a2d-9d627233ef8f req-af061965-6572-4420-9983-5f8f2f6c20ed tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1112.141925] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1112.142253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.142377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.142444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.142643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.142828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.142927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.142990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.147339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.147475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.147528] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.583736] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.583950] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.584083] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.584351] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.584608] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.584765] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.585038] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.585270] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.585421] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.585630] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.585745] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.585888] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.586012] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.586147] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.586264] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.586399] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.603592] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.603768] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1112.603920] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.604141] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.604458] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.604684] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.604892] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.605246] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.605390] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('958ca267-8d7b-41a4-9b2a-5b8ffc7a3362',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.627695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1112.627901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.628071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.628279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.628464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.628581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.628652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.628806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.628862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.629042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.629148] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.650294] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.650481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.650530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.650709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.650802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.651051] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.651148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.651148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.651326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.651397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.651481] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1112.673268] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.673459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.673526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.673712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.673898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.682561] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1113.109160] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.109434] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.109561] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.109848] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.110029] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.110212] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 not found, creating... [ 1113.110492] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.110669] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.110788] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.111041] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.111188] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.111484] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.111669] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.111789] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.112016] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.112160] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.112315] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 is going to be created. [ 1113.130371] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.130664] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.130834] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.131190] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.131480] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.131794] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.132939] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.133089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.133154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.133512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.133863] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.134083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.134211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.134523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.134634] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.134739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.134921] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.135035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.135108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.135250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.135427] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.135519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.135594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.135736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.135890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.135930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.136018] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.637575] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50dc186b-34b2-45b3-89b7-2dfa7346dc41: rpc.has_security_group_logging(os_id): False [ 1113.654060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.654230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.654303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.654541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.654636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.654951] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.655075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.655142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.655339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.655377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.655603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.655706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.655770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.656490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.656490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.656490] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.656650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.656650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.656807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.656904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.656999] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1113.712848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.712965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.712965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.714056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.714056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.733066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1113.895039] env[69847]: INFO networking_nsxv3.common.synchronization [req-c5f35cee-2f4f-4b65-8a2d-9d627233ef8f req-0f4536f1-332a-40af-bba2-f64592d176bc service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 1113.895239] env[69847]: INFO networking_nsxv3.common.synchronization [req-c5f35cee-2f4f-4b65-8a2d-9d627233ef8f req-0f4536f1-332a-40af-bba2-f64592d176bc service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1113.895380] env[69847]: INFO networking_nsxv3.common.synchronization [req-c5f35cee-2f4f-4b65-8a2d-9d627233ef8f req-0f4536f1-332a-40af-bba2-f64592d176bc service nova] Enqueued Resource ID: 958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 with Priority: HIGHEST for action port [ 1113.895619] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 1113.898614] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1113.898614] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 with Priority: HIGHEST for action port [ 1113.898614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.898614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.898614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.898614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.898614] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.898614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.898614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.898614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.898614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.899261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.899261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.899261] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('958ca267-8d7b-41a4-9b2a-5b8ffc7a3362',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.400726] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 with status ACTIVE [ 1114.400961] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.401452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.401452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.401452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.401452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.401638] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.401791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.401791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.401983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.402023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.403641] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.403641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.403641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.403641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.403641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.403641] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 958ca267-8d7b-41a4-9b2a-5b8ffc7a3362 is going to be updated. [ 1114.403840] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.404316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.422293] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.422293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.422293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.422293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.422485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.422511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-958ca267-8d7b-41a4-9b2a-5b8ffc7a3362" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.692722] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1114.693022] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f deletion is rescheduled due to dependency. [ 1114.693078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.694143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.694143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.694143] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.694143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.694143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.694352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.694352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.694352] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.196549] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.555338] env[69847]: INFO networking_nsxv3.common.synchronization [None req-dbd308e4-bf29-4447-a819-1165e55f5a1e tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_rules [ 1115.555907] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_rules [ 1115.557021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.557021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.557021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.560019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.560019] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.653643] env[69847]: INFO networking_nsxv3.common.synchronization [None req-135c2798-72be-4a84-b23a-cd2689302142 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_rules [ 1115.654169] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_rules [ 1115.654465] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.654561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.699279] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.758253] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1115.758498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.076990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.077141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.077208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.077644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.077713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.077897] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb already deleted. [ 1116.077971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.078152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.078745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.078745] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.202468] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.202663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.202749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.203033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.203132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.203237] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1116.229332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.229526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.229598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.229899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.230143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.238889] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1116.511990] env[69847]: INFO networking_nsxv3.common.synchronization [req-ee75a0cf-0fb6-4d51-b419-8ac608d20e8f req-02875cfb-6d01-47be-9c80-8d78720679e0 tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_members [ 1116.511990] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_members [ 1116.511990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.511990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.511990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.512601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.512919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.515093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.515093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.515093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.515093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.515093] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.600553] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.600553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.600553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.600712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.600712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.600810] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb already deleted. [ 1116.600836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.917653] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.918015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.918015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.918262] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.918520] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.918681] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.918803] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.919036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.919184] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.919398] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.919514] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.919624] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.919746] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.919866] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.919954] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.920102] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.946793] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.946950] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.947094] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.947278] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-910" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.947592] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-d7a26410-df8b-43c7-9108-485969f8a11e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.947789] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.947885] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.948240] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.948411] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a26410-df8b-43c7-9108-485969f8a11e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.021209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.021470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.021702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.022121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.022319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.022632] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.022804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.022904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.023186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.023345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.023457] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 already deleted. [ 1117.023549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.450981] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.451223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.451372] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.451657] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.451817] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.451978] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port d7a26410-df8b-43c7-9108-485969f8a11e not found, creating... [ 1117.452273] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.452526] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.452607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.452841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.453019] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.453308] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.453476] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.453594] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.453805] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.454014] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.454186] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: d7a26410-df8b-43c7-9108-485969f8a11e is going to be created. [ 1117.472630] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.472855] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.473069] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.473660] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.473660] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.473828] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.205203] env[69847]: INFO networking_nsxv3.common.synchronization [req-ee75a0cf-0fb6-4d51-b419-8ac608d20e8f req-9fb76c5b-c9f3-4ec4-82c8-5f2d9377c434 service nova] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_rules [ 1118.205476] env[69847]: INFO networking_nsxv3.common.synchronization [req-ee75a0cf-0fb6-4d51-b419-8ac608d20e8f req-9fb76c5b-c9f3-4ec4-82c8-5f2d9377c434 service nova] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_members [ 1118.205541] env[69847]: INFO networking_nsxv3.common.synchronization [req-ee75a0cf-0fb6-4d51-b419-8ac608d20e8f req-9fb76c5b-c9f3-4ec4-82c8-5f2d9377c434 service nova] Enqueued Resource ID: d7a26410-df8b-43c7-9108-485969f8a11e with Priority: HIGHEST for action port [ 1118.206088] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_rules [ 1118.206499] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_members [ 1118.206499] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a26410-df8b-43c7-9108-485969f8a11e with Priority: HIGHEST for action port [ 1118.206611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.206696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.206757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.206945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.208396] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.210447] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.210535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.210597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.210779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.210921] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.211053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.211113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.211403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.211403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.211403] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.212119] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a26410-df8b-43c7-9108-485969f8a11e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.212200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.212242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.215233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.215233] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a26410-df8b-43c7-9108-485969f8a11e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.248224] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1118.248224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.248410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.248568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.248804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.249073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.249162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.249307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.249388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.249471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.251512] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.715797] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.715991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.716233] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.720106] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7a26410-df8b-43c7-9108-485969f8a11e with status ACTIVE [ 1118.720106] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.720322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.720322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.720505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.720563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.720795] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.720947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.721050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.721219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.721301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.721480] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.723264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.723264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.723264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.723264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.723264] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7a26410-df8b-43c7-9108-485969f8a11e is going to be updated. [ 1118.741288] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.741288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.741288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.741519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.742419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.742419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a26410-df8b-43c7-9108-485969f8a11e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.752868] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.218042] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.255283] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7c8712-c7ea-4340-b068-333e83abf23f: rpc.has_security_group_logging(os_id): False [ 1119.271857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.272007] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.272124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.272382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.272475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.272725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.272875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.272939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.273107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.273186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.273272] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1119.324972] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.325149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.325242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.325455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.325605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.336384] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1119.720647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.720755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.720790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.720997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.721105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.722257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 is going to be created. [ 1119.744513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.744659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.744734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.745054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.745239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.755822] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 in Status: UNINITIALIZED for 2s [ 1119.761067] env[69847]: INFO networking_nsxv3.common.synchronization [req-49cae4f1-b8af-4c22-8641-6d0ce9ba864d req-aaf7a292-8c6b-4200-9de1-1a2c48f3f634 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1119.761316] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1119.762223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.762223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.762223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.762609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.762609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.762690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.762864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.762983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.763093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.763186] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.139328] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.139328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.139328] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.140531] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.140610] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.140721] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.140841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.141102] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.141257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.141472] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.141874] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.141874] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.141874] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.141874] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1120.142075] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.142132] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.159863] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.160034] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1120.160180] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.160347] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.160741] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-72b6ee15-db72-45bc-ac91-0e385963f052 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.160912] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.161052] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.161359] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.161499] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b6ee15-db72-45bc-ac91-0e385963f052',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.264820] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.664257] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.664527] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.664595] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.664947] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.665098] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.665266] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 72b6ee15-db72-45bc-ac91-0e385963f052 not found, creating... [ 1120.665549] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.665717] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.665839] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.666150] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.666330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.666690] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.666885] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.667072] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.667377] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.667584] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.667834] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 72b6ee15-db72-45bc-ac91-0e385963f052 is going to be created. [ 1120.687565] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.687920] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.688176] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.689270] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.689663] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.690078] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.767947] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.272367] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.272684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.272684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.272777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.272991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.272991] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be updated. [ 1121.300053] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.300053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.300053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.300272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.300377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.308759] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: IN_PROGRESS for 2s [ 1121.347297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1121.347545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.453428] env[69847]: INFO networking_nsxv3.common.synchronization [req-49cae4f1-b8af-4c22-8641-6d0ce9ba864d req-a083473f-47e0-4e95-b7a8-8dc0d3cca2ad service nova] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1121.453615] env[69847]: INFO networking_nsxv3.common.synchronization [req-49cae4f1-b8af-4c22-8641-6d0ce9ba864d req-a083473f-47e0-4e95-b7a8-8dc0d3cca2ad service nova] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1121.453770] env[69847]: INFO networking_nsxv3.common.synchronization [req-49cae4f1-b8af-4c22-8641-6d0ce9ba864d req-a083473f-47e0-4e95-b7a8-8dc0d3cca2ad service nova] Enqueued Resource ID: 72b6ee15-db72-45bc-ac91-0e385963f052 with Priority: HIGHEST for action port [ 1121.454432] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_rules [ 1121.454610] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1121.454682] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b6ee15-db72-45bc-ac91-0e385963f052 with Priority: HIGHEST for action port [ 1121.455203] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.455203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.455289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.455520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.455589] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.456484] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.456971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.456971] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-72b6ee15-db72-45bc-ac91-0e385963f052 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.457227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.457227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.457326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.457367] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72b6ee15-db72-45bc-ac91-0e385963f052',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.765969] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 in Status: SUCCESS [ 1121.766251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.766419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.766653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.766858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.766991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.767139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.767324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.767415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.767501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.767590] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.872982] env[69847]: INFO networking_nsxv3.common.synchronization [req-143f040e-2bb0-46ad-b586-9466531a59e3 req-91a889da-a754-4235-936d-56471e71aac8 tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 1121.873578] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 1121.873757] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.874405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.874516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.874750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.874993] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.875178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.875249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.875431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.875514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.875614] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.959313] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.959313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.960032] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72b6ee15-db72-45bc-ac91-0e385963f052 with status ACTIVE [ 1121.960032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.960032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.960032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.960032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.960424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.960424] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.960495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.960560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.960761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.960879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.961071] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.961457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.961457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.961569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.961651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.961738] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72b6ee15-db72-45bc-ac91-0e385963f052 is going to be updated. [ 1121.984195] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.984286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.984375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.984623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.984781] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.985031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72b6ee15-db72-45bc-ac91-0e385963f052" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.270277] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.378745] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.775122] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cc6dd9-4b19-4296-b4c7-99f45d6a0146: rpc.has_security_group_logging(os_id): False [ 1122.792628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.792905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.793027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.793417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.793527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.793910] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.794105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.794227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.794511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.794667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.794794] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 is going to be created. [ 1122.852303] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.852501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.852581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.852800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.853234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.862224] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 in Status: IN_PROGRESS for 2s [ 1122.883722] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.322077] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1123.322077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.322348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.322417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.322601] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.322759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.322844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.323031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.323107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.323187] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.386875] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.386875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.386875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.387469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.387469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.387469] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 1123.413338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.413528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.413528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.413851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.414035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.421866] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 1123.826435] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.327520] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.833609] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.833984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.833984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.834140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.834243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.834345] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be updated. [ 1124.861456] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.861667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.861748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.861957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.862130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.872056] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: IN_PROGRESS for 2s [ 1124.875154] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 in Status: SUCCESS [ 1124.875437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.430529] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 1125.430748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.521246] env[69847]: INFO networking_nsxv3.common.synchronization [req-f977c465-83f5-4aaf-95fd-372de1830840 req-dafc6c43-e78c-46ba-9f38-bde0e7162dc5 tempest-ServersAdminTestJSON-1432726417 tempest-ServersAdminTestJSON-1432726417-project-member] Enqueued Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1125.522046] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff with Priority: HIGHEST for action security_group_members [ 1125.522180] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.522290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.522395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.522767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.523052] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.523163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.523163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.523302] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.523385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.523478] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('320d8032-7c7f-4adf-9aaa-d27d0fb2efff',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.970351] env[69847]: INFO networking_nsxv3.common.synchronization [req-fd8365e6-115a-4587-aed5-4dd4badc9be4 req-cd6ac5f6-3317-4cb7-b6ec-bbd8b524bb45 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1125.970659] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1125.970927] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.971130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.971208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.971420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.971576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.971674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.971735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.971877] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.971960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.972065] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.027646] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.027646] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.027646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.027646] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff is going to be updated. [ 1126.051570] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.051814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.051814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.052103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.052164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.060150] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: IN_PROGRESS for 2s [ 1126.284924] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.284924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.284924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.285238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.285293] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.290163] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.290163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.290163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.290163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.290163] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.290163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.290163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.290163] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.290631] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.290751] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.290873] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.290998] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.291174] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.291294] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1126.291402] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.291535] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.309427] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.309623] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1126.309769] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.309949] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.310517] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-8b389870-49f5-4859-bf1d-192ae121ccf3 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.310722] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.310846] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.311199] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.311340] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b389870-49f5-4859-bf1d-192ae121ccf3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.476157] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.793863] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.814677] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.814891] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.815086] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.815428] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.815602] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.815749] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 8b389870-49f5-4859-bf1d-192ae121ccf3 not found, creating... [ 1126.816063] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.816224] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.816348] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.816567] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.816705] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.817037] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.817271] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.817353] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.817847] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.817847] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.817847] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 8b389870-49f5-4859-bf1d-192ae121ccf3 is going to be created. [ 1126.836038] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.836267] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.836396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.836674] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.836931] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.837153] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.881830] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1126.882141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.882310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.882521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.882706] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.882818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.882943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.883125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.884525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.884663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.884760] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.976543] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.092315] env[69847]: INFO networking_nsxv3.common.synchronization [req-b08c819b-c0fe-4ee4-b836-9b32a2b01a4b req-c4ff9e67-c6f4-4a17-88d0-9b6c9eb44efb tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1127.093036] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1127.093281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.097027] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.097027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.097027] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.296389] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.390161] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.479026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.479158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.479231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.479454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.479543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.479636] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1127.511079] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.511535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.511535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.511651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.511754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.520031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1127.596191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.596435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.596550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.596860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.597022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.597319] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.597412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.597474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.597959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.597959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.597959] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1127.628686] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.628862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.628928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.629192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.629377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.638121] env[69847]: INFO networking_nsxv3.common.synchronization [req-fd8365e6-115a-4587-aed5-4dd4badc9be4 req-dcc9bd3b-83f6-4574-88a3-5b1a4a5fdb52 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1127.638306] env[69847]: INFO networking_nsxv3.common.synchronization [req-fd8365e6-115a-4587-aed5-4dd4badc9be4 req-dcc9bd3b-83f6-4574-88a3-5b1a4a5fdb52 service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1127.638447] env[69847]: INFO networking_nsxv3.common.synchronization [req-fd8365e6-115a-4587-aed5-4dd4badc9be4 req-dcc9bd3b-83f6-4574-88a3-5b1a4a5fdb52 service nova] Enqueued Resource ID: 8b389870-49f5-4859-bf1d-192ae121ccf3 with Priority: HIGHEST for action port [ 1127.639314] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1127.639448] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1127.639578] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1127.639678] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b389870-49f5-4859-bf1d-192ae121ccf3 with Priority: HIGHEST for action port [ 1127.640244] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.640339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.640401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.640724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.640806] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.641644] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.641741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.641926] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b389870-49f5-4859-bf1d-192ae121ccf3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.642076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.642102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.642253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.642324] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b389870-49f5-4859-bf1d-192ae121ccf3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.799093] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1127.799203] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1127.892017] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf911be5-2488-4f40-9c8d-53a9a8a05396: rpc.has_security_group_logging(os_id): False [ 1127.907918] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.908085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.908189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.908395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.908486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.908730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.908827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.909395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.909395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.909395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.909395] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be updated. [ 1127.960866] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.961076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.961158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.961408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.961563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.973015] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: IN_PROGRESS for 2s [ 1128.070694] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff in Status: SUCCESS [ 1128.071047] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 320d8032-7c7f-4adf-9aaa-d27d0fb2efff deletion is rescheduled due to dependency. [ 1128.071047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-320d8032-7c7f-4adf-9aaa-d27d0fb2efff" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.145758] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147187] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b389870-49f5-4859-bf1d-192ae121ccf3 with status ACTIVE [ 1128.147187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.147187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.147187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.147679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.147679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.147679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.147813] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b389870-49f5-4859-bf1d-192ae121ccf3 is going to be updated. [ 1128.170098] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.170247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.170247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.170421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.170587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.170693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b389870-49f5-4859-bf1d-192ae121ccf3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.627971] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.628152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.628152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.628365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.639783] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1128.640748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.641862] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1128.674255] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.674404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.674518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.674722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.685525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.686181] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1128.686808] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1128.686808] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1128.724018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.724018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.724018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.724018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.724533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.724833] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1128.797198] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.797198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.797198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.797198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.797198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.797198] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1128.870157] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.870157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.870157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.870608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.871072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.873161] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1128.873161] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'07375a76-81ac-4415-b226-523a25ff6c62', 'f78c8839-8143-4fa9-8d9a-46b39052b3a4', 'fefa82bf-be1b-4e2a-9d96-94b63738ba8c', '39c88011-49df-4c92-a73f-ef1e67d3d9e4', '90e98e92-8284-4e76-b863-496da25fff54', '464d4153-37e1-4ee4-acaa-e78786c77e75', '447511d4-51f2-4b25-94d1-cdabf552a536', '2ddfb0ca-be41-4aab-86c8-f25898604880', '4ebba71e-a742-472f-8890-25c0bf66f3fa', 'b495386a-9f65-4bd6-a72b-2cc4c5b333fe', 'b8ca119d-bde2-4386-8868-06f3fb18260c', 'e41d6c35-289a-46b1-9113-0dea949327e3', 'd83415f8-9fcd-4d12-80dc-6b4d7143c3f4', '39d07bbc-a59b-4d28-acdb-434bfad90729', '5fa7dd18-0289-4c11-8f13-4837e0914735', '0e7c8712-c7ea-4340-b068-333e83abf23f', '8d38a5b8-0315-4edd-b894-d3dd2b712ed5', 'd1db1aa4-6c31-4471-86d2-9d1b7fbb6d37', '08043f9f-80db-4591-bf09-4b14d00f17ee', 'def2b8bf-1a3c-42a9-ba24-20811016588c', '787bb710-aa55-4d74-8a05-06d3f5d80ddb', 'b8f57242-fc73-4330-af5c-da599a57f0de', '8274668c-f732-47b5-a698-409c1e7afb7c', '45cc6dd9-4b19-4296-b4c7-99f45d6a0146', '804e0265-2d3b-49e8-899e-80d4d047aae0', 'c523ece5-b863-4da0-bab3-ae503f8fa633', '342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d', '777d5afe-018d-46de-82b7-4dde124236a9', '72471c75-08a5-45be-9362-d9463542469e', 'e1f264c4-f165-4427-b9e3-23d05179073b', '70472fc2-8f2e-4656-96c9-97081b657aa2', '2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e', 'cf911be5-2488-4f40-9c8d-53a9a8a05396', '2390abe6-0ba8-4ab0-8c91-187bd39ef80c', '3c88aae7-5837-4451-89b6-8972ab00f699', 'de342dad-fb8d-4c7b-87ea-595f01e3c6be', '8982c0b6-8a83-4e29-82e9-02c4a6ebebad', 'bd9acc22-8a8b-484a-8e94-b168c183d5d8', 'd49fbfa3-cbed-486e-8169-864e1a046ae7', '6dab7dc1-01c6-41fb-8400-c0b26437fd97', '39d08516-0c16-4674-ac9d-29023bc28795', '8022d569-fc48-4639-a726-38e4b078eac1', '9adcb44b-15db-439a-8e0e-af687bcfa50b', 'a895e100-517f-40a3-99b4-4b43ee1bd032', '2b2d82cb-7e65-491f-8df0-d52a50997ba5', '538bdf43-fa07-48d1-906e-f7fa68a3a739', 'd0084e13-9513-4d73-a5ee-3f7440f23dd3', '320d8032-7c7f-4adf-9aaa-d27d0fb2efff', '598796a3-3295-47ec-afb1-170cde7401b5', '4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d', '50dc186b-34b2-45b3-89b7-2dfa7346dc41'} {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1128.873161] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1128.890640] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.890640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.890640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.890640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.890640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.890640] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1128.890640] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1128.890640] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1128.955058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.959061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.959061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.959061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.959061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.959061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1128.959061] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1128.959061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1128.959061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1128.959061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGH for action security_group_rules [ 1128.959061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.530707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1129.531042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.531096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.531321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.531502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.531613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.531678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.531829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.532010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.532010] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.574170] env[69847]: INFO networking_nsxv3.common.synchronization [None req-23bd37b6-d740-4881-b644-a59f722892dd tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1129.574424] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1129.574565] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07375a76-81ac-4415-b226-523a25ff6c62 with Priority: HIGH for action security_group_rules [ 1129.574665] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGH for action security_group_rules [ 1129.574784] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGH for action security_group_rules [ 1129.574873] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 with Priority: HIGH for action security_group_rules [ 1129.575033] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def2b8bf-1a3c-42a9-ba24-20811016588c with Priority: HIGH for action security_group_rules [ 1129.575615] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08043f9f-80db-4591-bf09-4b14d00f17ee with Priority: HIGH for action security_group_rules [ 1129.576440] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 with Priority: HIGH for action security_group_rules [ 1129.576588] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 with Priority: HIGH for action security_group_rules [ 1129.576694] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 with Priority: HIGH for action security_group_rules [ 1129.576791] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGH for action security_group_rules [ 1129.576886] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 with Priority: HIGH for action security_group_rules [ 1129.579389] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGH for action security_group_rules [ 1129.579568] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ca119d-bde2-4386-8868-06f3fb18260c with Priority: HIGH for action security_group_rules [ 1129.579681] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe with Priority: HIGH for action security_group_rules [ 1129.579781] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGH for action security_group_rules [ 1129.580393] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 with Priority: HIGH for action security_group_rules [ 1129.580544] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 with Priority: HIGH for action security_group_rules [ 1129.580650] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGH for action security_group_rules [ 1129.580745] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 with Priority: HIGH for action security_group_rules [ 1129.580839] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 with Priority: HIGH for action security_group_rules [ 1129.581161] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.581282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.581576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.581817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.581978] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.582118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.582160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.582320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.582393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.582669] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.583775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07375a76-81ac-4415-b226-523a25ff6c62 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.583887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.583958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.584120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.584197] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07375a76-81ac-4415-b226-523a25ff6c62',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.588372] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.588478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.588544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.588695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.588767] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.589488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.589595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.589660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.589806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.589877] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.590675] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fa7dd18-0289-4c11-8f13-4837e0914735 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.590783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.590846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.590991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.591654] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fa7dd18-0289-4c11-8f13-4837e0914735',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.592474] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-def2b8bf-1a3c-42a9-ba24-20811016588c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.592633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.592701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.592849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.592921] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('def2b8bf-1a3c-42a9-ba24-20811016588c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.594122] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08043f9f-80db-4591-bf09-4b14d00f17ee taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.594122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.594122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.594122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.594122] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08043f9f-80db-4591-bf09-4b14d00f17ee',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.594946] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.595744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.595823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.595978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.596097] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.596853] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.598381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.598483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.598644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.598719] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d38a5b8-0315-4edd-b894-d3dd2b712ed5',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.599387] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d07bbc-a59b-4d28-acdb-434bfad90729 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.599758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.599758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.599758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.599758] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d07bbc-a59b-4d28-acdb-434bfad90729',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.600425] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.600525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.600588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.600735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.600804] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.602488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.602488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.602488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.602673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.602673] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d83415f8-9fcd-4d12-80dc-6b4d7143c3f4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.603416] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.603516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.603571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.603715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.603780] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.604587] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8ca119d-bde2-4386-8868-06f3fb18260c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.604731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.604731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.604824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.604824] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8ca119d-bde2-4386-8868-06f3fb18260c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.607359] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.607510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.610838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.611102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.611395] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495386a-9f65-4bd6-a72b-2cc4c5b333fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.612785] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.612915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.612995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.613217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.613299] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.615744] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-464d4153-37e1-4ee4-acaa-e78786c77e75 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.615934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.615934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.616128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.616196] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('464d4153-37e1-4ee4-acaa-e78786c77e75',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.617075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ddfb0ca-be41-4aab-86c8-f25898604880 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.617177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.617216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.617391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.617489] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ddfb0ca-be41-4aab-86c8-f25898604880',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.618451] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.619034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.619034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.619491] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.619583] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.620317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.620490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.620574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.620754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.620850] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f78c8839-8143-4fa9-8d9a-46b39052b3a4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.621701] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.621883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.621951] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.622164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.622264] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c88011-49df-4c92-a73f-ef1e67d3d9e4',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.649909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.650080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.650144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.650423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.652523] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.652656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.653390] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.653496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.654384] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1129.654563] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 deletion is rescheduled due to dependency. [ 1129.654672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.670897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.670897] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d83415f8-9fcd-4d12-80dc-6b4d7143c3f4 is going to be deleted. [ 1129.672083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.672309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.690032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.690032] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8ca119d-bde2-4386-8868-06f3fb18260c is going to be deleted. [ 1129.691429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.691651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.708169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.708956] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07375a76-81ac-4415-b226-523a25ff6c62 is going to be deleted. [ 1129.738404] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.738535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.738606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.738813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.738906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.739040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d83415f8-9fcd-4d12-80dc-6b4d7143c3f4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.739719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.740776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.740776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.740776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.740776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.740776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8ca119d-bde2-4386-8868-06f3fb18260c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.754169] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.754306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.754391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.754630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.754728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.754860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07375a76-81ac-4415-b226-523a25ff6c62" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.999586] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1129.999857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.034389] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.128524] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.128676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.128676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.128813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.129011] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.130430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.130522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.130678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.131213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.131213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.131213] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.138204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.138204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.138204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.138204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.142976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.142976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.142976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.142976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.143134] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.143400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.143463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.143633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.143715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.143806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.143905] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.145903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.146910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.147648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.147648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.147648] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.147648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.147648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.147648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.147648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.148274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.148274] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.149995] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.150126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.195953] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.196234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.196905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.197015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.197702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.197794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.198446] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.198549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.199569] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.199671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.209699] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.209699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.209699] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.209699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.209699] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.209699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.211276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.214024] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495386a-9f65-4bd6-a72b-2cc4c5b333fe is going to be deleted. [ 1130.214520] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.214656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.214715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.214897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.217878] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.218619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.219473] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.219616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.220184] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.220632] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.220745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.221388] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.221794] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.221901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.239646] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.240214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.240369] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: def2b8bf-1a3c-42a9-ba24-20811016588c is going to be deleted. [ 1130.241409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.241661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.258500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.258702] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be deleted. [ 1130.259604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.259823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.275853] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.276071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.279650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.279780] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d07bbc-a59b-4d28-acdb-434bfad90729 is going to be deleted. [ 1130.280596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.280804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.291243] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.291444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.301219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.301336] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f78c8839-8143-4fa9-8d9a-46b39052b3a4 is going to be deleted. [ 1130.302212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.302414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.318630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.318755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be deleted. [ 1130.319631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.319837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.336317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.336543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.349254] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.349473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.354415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.354547] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ddfb0ca-be41-4aab-86c8-f25898604880 is going to be deleted. [ 1130.355437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.355651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.383361] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.383660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.388543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.388681] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37 is going to be deleted. [ 1130.389678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.389892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.405130] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.405272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.461561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.461730] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d38a5b8-0315-4edd-b894-d3dd2b712ed5 is going to be deleted. [ 1130.462646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.462881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.464393] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.464523] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.487263] env[69847]: INFO networking_nsxv3.common.synchronization [req-526b0a03-36d2-48bf-b16e-34ba52ae8fb2 req-bd046f98-f3d0-437e-a298-63062da8cd12 tempest-ServerRescueTestJSON-1705482383 tempest-ServerRescueTestJSON-1705482383-project-member] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1130.487816] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1130.488133] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.488259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.488324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.488517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.488664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.488756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.488939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.488939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.489096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.489143] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.510121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.510247] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08043f9f-80db-4591-bf09-4b14d00f17ee is going to be deleted. [ 1130.511567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.511712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.537335] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.564899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.565172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.594555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.594847] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.594966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.595094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.595297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.595378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.595470] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1130.596625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.596827] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.598566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.598566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.641228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.641228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.641228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.641228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.641228] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.641796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.641796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.641796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.641796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.641796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.641796] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.656326] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.660640] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.662119] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.662222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.666884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.666991] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 464d4153-37e1-4ee4-acaa-e78786c77e75 is going to be deleted. [ 1130.669259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.669259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.705492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.705664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.705763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.706034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.706246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.721921] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1130.735539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.735716] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fa7dd18-0289-4c11-8f13-4837e0914735 is going to be deleted. [ 1130.736596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.736801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.736887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.736979] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be deleted. [ 1130.737739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.737899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.769014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.769166] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c88011-49df-4c92-a73f-ef1e67d3d9e4 is going to be deleted. [ 1130.770278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.770513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.770602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.770721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495386a-9f65-4bd6-a72b-2cc4c5b333fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.770875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.771051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.771174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.771252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-def2b8bf-1a3c-42a9-ba24-20811016588c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.771726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.771910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.772033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.772483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.772569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d07bbc-a59b-4d28-acdb-434bfad90729" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.772969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.773073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.773183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f78c8839-8143-4fa9-8d9a-46b39052b3a4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.773312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.773433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.773522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.773629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.773799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.773892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.773972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.774224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ddfb0ca-be41-4aab-86c8-f25898604880" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.774362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.774494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.774578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.774746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1db1aa4-6c31-4471-86d2-9d1b7fbb6d37" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.774891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.775054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.775128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.775239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d38a5b8-0315-4edd-b894-d3dd2b712ed5" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.775363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.775499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.775572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.775678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08043f9f-80db-4591-bf09-4b14d00f17ee" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.798335] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.798554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.798554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.798734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.798820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.798930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-464d4153-37e1-4ee4-acaa-e78786c77e75" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.830746] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.830890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.830963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.831181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.831261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.831377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fa7dd18-0289-4c11-8f13-4837e0914735" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.864539] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.864539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.864539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.864539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.864539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.864539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.895995] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1130.897208] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.897524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.897708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.898228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.899042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.899276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c88011-49df-4c92-a73f-ef1e67d3d9e4" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.993023] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.040732] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.043309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.043309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.043309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.043309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.043309] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1131.079479] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.079612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.079679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.079882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.080032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.089402] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1131.143390] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ebba71e-a742-472f-8890-25c0bf66f3fa: rpc.has_security_group_logging(os_id): False [ 1131.158844] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90e98e92-8284-4e76-b863-496da25fff54: rpc.has_security_group_logging(os_id): False [ 1131.163195] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7c8712-c7ea-4340-b068-333e83abf23f: rpc.has_security_group_logging(os_id): False [ 1131.173462] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.173604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.173674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.173884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.187736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.187864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.209571] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.209710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.212443] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.212664] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.212777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.213973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.213973] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.213973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.213973] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.214355] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.214355] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.214457] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.214521] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.214638] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.214834] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.214882] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.214943] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.215150] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.216997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.217328] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.217443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.217496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.217680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.217766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.217941] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.218052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.218102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.218271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.218351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.218566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.218678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.218747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.218889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.218959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.219063] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 1131.221272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.221440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.254901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.256114] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.256323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.256379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.256551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.256633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.256718] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e98e92-8284-4e76-b863-496da25fff54 is going to be updated. [ 1131.257800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.257980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.259139] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.259305] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1131.259445] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.259610] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-596" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.259900] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-bcc1de7b-8497-42fe-858a-37a020dc8c00 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.260095] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.260196] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.260474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.260614] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcc1de7b-8497-42fe-858a-37a020dc8c00',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.279911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.280240] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.280370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.280451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.280616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.280702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.280773] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1131.297873] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.298067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.298137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.298291] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.298427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.388109] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 1131.412996] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.413188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.413188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.413406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.413517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.443212] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.443434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.443487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.443693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.443841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.445980] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: IN_PROGRESS for 2s [ 1131.458769] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1131.496092] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.763123] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.763426] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.764118] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.764118] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.764118] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.764118] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port bcc1de7b-8497-42fe-858a-37a020dc8c00 not found, creating... [ 1131.764378] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.764542] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.764762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.764879] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.765048] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.765528] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.765528] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.765658] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.765795] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.765926] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.766128] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: bcc1de7b-8497-42fe-858a-37a020dc8c00 is going to be created. [ 1131.784991] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.784991] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.784991] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.785468] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.785798] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.786135] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.998101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.998101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.998101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.998101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.998101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.998101] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be updated. [ 1132.035395] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.035395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.035494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.035635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.035779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.044187] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: IN_PROGRESS for 2s [ 1132.524152] env[69847]: INFO networking_nsxv3.common.synchronization [req-526b0a03-36d2-48bf-b16e-34ba52ae8fb2 req-9f87a03a-c570-4059-8941-b4f0655fe301 service nova] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_rules [ 1132.524337] env[69847]: INFO networking_nsxv3.common.synchronization [req-526b0a03-36d2-48bf-b16e-34ba52ae8fb2 req-9f87a03a-c570-4059-8941-b4f0655fe301 service nova] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1132.524477] env[69847]: INFO networking_nsxv3.common.synchronization [req-526b0a03-36d2-48bf-b16e-34ba52ae8fb2 req-9f87a03a-c570-4059-8941-b4f0655fe301 service nova] Enqueued Resource ID: bcc1de7b-8497-42fe-858a-37a020dc8c00 with Priority: HIGHEST for action port [ 1132.524708] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_rules [ 1132.524836] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1132.524929] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcc1de7b-8497-42fe-858a-37a020dc8c00 with Priority: HIGHEST for action port [ 1132.525543] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.525660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.525726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.525923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.526016] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.528554] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.528693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.530655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcc1de7b-8497-42fe-858a-37a020dc8c00 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.530655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.530655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.530655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.530655] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcc1de7b-8497-42fe-858a-37a020dc8c00',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.730758] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1132.730989] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 deletion is rescheduled due to dependency. [ 1132.731176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.031502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.031967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.031967] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcc1de7b-8497-42fe-858a-37a020dc8c00 with status ACTIVE [ 1133.032093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.032203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.032203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.032579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.032579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.032728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.032818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.032878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.033069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.033161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.033430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.033526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.033558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.033704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.033775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.033881] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcc1de7b-8497-42fe-858a-37a020dc8c00 is going to be updated. [ 1133.054128] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.054271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.054351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.054622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.054763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.054917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcc1de7b-8497-42fe-858a-37a020dc8c00" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.097013] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1133.097250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.097422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.097670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.097858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.097975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.098048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.098225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.098303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.098408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.098485] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.152659] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.152865] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.153028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.153312] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.153577] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.153741] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.153859] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.154085] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.154237] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.154783] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.154783] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.154783] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.154783] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.154995] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.154995] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.155182] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.172375] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.172556] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1133.172704] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.172887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.173297] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-a56a1f10-b9b7-42eb-9502-c6210287139b taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.173509] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.173641] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.173930] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.174102] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56a1f10-b9b7-42eb-9502-c6210287139b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.400951] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 1133.401183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.459957] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: SUCCESS [ 1133.460504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.472007] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1133.472376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.600903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.601079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.601154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.601375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.601546] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.601644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.601701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.601849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.601936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.602034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.602234] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.602288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.602315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.602453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.602579] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.602666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.602725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.602857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.602955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.603165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.603303] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.676921] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.677156] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.677297] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.679292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.679465] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.679757] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.679917] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.680052] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.680279] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.680419] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.680711] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.681277] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.681277] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.681277] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.681406] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.681516] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: a56a1f10-b9b7-42eb-9502-c6210287139b is going to be updated. [ 1133.702576] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.702774] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.702901] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.703241] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.703444] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.703659] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.053804] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1134.054088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.054200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.054412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.054592] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.054705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.054769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.054913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.054992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.055120] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.105986] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 1134.122804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.123028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.123028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.123240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.139453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.139717] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.139841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.139906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.140123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.140206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.140417] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.140517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.140577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.140721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.140794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.140970] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.141073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.141135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.141271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.141344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.141426] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1134.198792] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.198922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.198985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.199205] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.199350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.214942] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1134.448035] env[69847]: INFO networking_nsxv3.common.synchronization [req-1b048006-fb7d-4c7f-8ad3-246f4ab926fb req-ab8e1ac6-b164-4983-bfc8-bccb94f73583 service nova] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1134.448035] env[69847]: INFO networking_nsxv3.common.synchronization [req-1b048006-fb7d-4c7f-8ad3-246f4ab926fb req-ab8e1ac6-b164-4983-bfc8-bccb94f73583 service nova] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1134.448035] env[69847]: INFO networking_nsxv3.common.synchronization [req-1b048006-fb7d-4c7f-8ad3-246f4ab926fb req-ab8e1ac6-b164-4983-bfc8-bccb94f73583 service nova] Enqueued Resource ID: a56a1f10-b9b7-42eb-9502-c6210287139b with Priority: HIGHEST for action port [ 1134.448035] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_rules [ 1134.448035] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1134.448035] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56a1f10-b9b7-42eb-9502-c6210287139b with Priority: HIGHEST for action port [ 1134.448035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.448035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.448035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.448035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.448035] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.449664] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.449931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.450132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.450601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.451297] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.451297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.451297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.451297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.451297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.451527] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.452346] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a56a1f10-b9b7-42eb-9502-c6210287139b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.455062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.455062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.455062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.455062] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56a1f10-b9b7-42eb-9502-c6210287139b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.557272] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.954311] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.954460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.954668] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.956983] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a56a1f10-b9b7-42eb-9502-c6210287139b with status ACTIVE [ 1134.957209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.957330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.957445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.957642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.957737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.957917] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.958605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.958605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.958605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.958605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.958605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.958605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.958782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.958782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.958836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.958937] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a56a1f10-b9b7-42eb-9502-c6210287139b is going to be updated. [ 1134.978881] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.979070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.979153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.979282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.979416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.979565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a56a1f10-b9b7-42eb-9502-c6210287139b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.059922] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.457464] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.562321] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.563034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.563034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.563034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.563034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.563034] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be updated. [ 1135.599481] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.599665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.599665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.600788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.600788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.612914] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: IN_PROGRESS for 2s [ 1135.960544] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.960775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.960905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.961249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.961891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.961891] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 is going to be updated. [ 1135.987762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.988019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.988019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.988193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.988343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.996583] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: IN_PROGRESS for 2s [ 1136.023590] env[69847]: INFO networking_nsxv3.common.synchronization [req-2d00394e-0427-4069-8626-5a36ee412554 req-fe7664c8-b790-4102-bdda-235260f9b1c8 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_members [ 1136.024286] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_members [ 1136.024603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.024725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.024791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.025236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.025435] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.025600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.025672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.025883] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.025980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.026133] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.233610] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1136.234069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.367293] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.367293] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.367293] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.367538] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.367773] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.367927] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.368110] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.368338] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.368492] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.368706] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.368824] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.368932] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.369052] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.369166] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.369275] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.369407] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.387860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.388269] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.388269] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.388391] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.388848] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-1582fce1-cb90-47f0-9862-cf85972b7125 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.389198] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.389340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.389666] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.389808] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1582fce1-cb90-47f0-9862-cf85972b7125',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.528950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.529166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.529166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.529779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.529779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.529779] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.529779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.529978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.529978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.530119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.530177] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb already deleted. [ 1136.530224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.892809] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.893050] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.893189] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.893403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.893532] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.893695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 1582fce1-cb90-47f0-9862-cf85972b7125 not found, creating... [ 1136.893954] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.894137] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.894257] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.894479] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.894618] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.894915] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.895337] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.895519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.895743] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.895887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.896044] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 1582fce1-cb90-47f0-9862-cf85972b7125 is going to be created. [ 1136.913988] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.914211] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914381] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.914782] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.915185] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.915440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.626464] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1137.626704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.626755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.626957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.627173] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.627303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.627366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.627553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.627631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.627715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.627816] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.630891] env[69847]: INFO networking_nsxv3.common.synchronization [req-2d00394e-0427-4069-8626-5a36ee412554 req-4c8ca5dd-14ac-4390-83c7-a217b378431c service nova] Enqueued Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_rules [ 1137.631064] env[69847]: INFO networking_nsxv3.common.synchronization [req-2d00394e-0427-4069-8626-5a36ee412554 req-4c8ca5dd-14ac-4390-83c7-a217b378431c service nova] Enqueued Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_members [ 1137.631222] env[69847]: INFO networking_nsxv3.common.synchronization [req-2d00394e-0427-4069-8626-5a36ee412554 req-4c8ca5dd-14ac-4390-83c7-a217b378431c service nova] Enqueued Resource ID: 1582fce1-cb90-47f0-9862-cf85972b7125 with Priority: HIGHEST for action port [ 1137.631618] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_rules [ 1137.631735] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_members [ 1137.631823] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1582fce1-cb90-47f0-9862-cf85972b7125 with Priority: HIGHEST for action port [ 1137.633793] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.633793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.633793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.633793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.633793] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.634087] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.634087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.634087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.634202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.634342] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.634436] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.634493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.634639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.634723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.634812] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.636144] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1582fce1-cb90-47f0-9862-cf85972b7125 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.636266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.636331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.636490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.636568] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1582fce1-cb90-47f0-9862-cf85972b7125',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.006335] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: SUCCESS [ 1138.006586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.006760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.006978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.007196] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.007318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.007397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.007572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.007652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.007736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.007841] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.133307] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.133307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.133307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.133307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.133564] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.133609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.133658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.133830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.133921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.134020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.134173] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.134266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.134321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.134473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.134596] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.134687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.134747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.134881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.134955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.135044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.135188] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.138023] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.138495] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.138585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.138890] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1582fce1-cb90-47f0-9862-cf85972b7125 with status ACTIVE [ 1138.139046] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.139147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.139212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.139357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.139432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.139598] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.139678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.139737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.139869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.139960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.140185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.140282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.140341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.140476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.140546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.140627] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1582fce1-cb90-47f0-9862-cf85972b7125 is going to be updated. [ 1138.160777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.160941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.160975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.161211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.161352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.161505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1582fce1-cb90-47f0-9862-cf85972b7125" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.510535] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.602302] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.602522] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.602664] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.602956] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.603306] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.603489] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.603619] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.603843] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.604025] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.604266] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.604392] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.604511] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.604629] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.604751] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.604868] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.605017] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.622100] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.622272] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.622518] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.623280] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.623280] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-2d0d656c-b406-4bdc-895f-873cc3d5f874 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.623280] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.623422] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.623660] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.623798] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0d656c-b406-4bdc-895f-873cc3d5f874',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.637236] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 777d5afe-018d-46de-82b7-4dde124236a9: rpc.has_security_group_logging(os_id): False [ 1138.640251] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.653308] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.653447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.653488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.653670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.671819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.671819] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.671819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.671819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.672075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.672075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.672263] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.672356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.672456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.672616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.672689] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.673022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.673022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.673150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.673910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.673910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.673910] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be updated. [ 1138.735838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.735838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.735838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.735985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.736222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.758785] env[69847]: INFO networking_nsxv3.common.synchronization [req-0e1fc84c-0be3-4372-823f-02e648f24dbf req-5eb6e525-6e81-4606-8918-326204a7aa36 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1138.759574] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1138.759924] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.760270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.760270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.760453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.760651] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.760792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.760918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.761095] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.761186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.761339] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.773696] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: IN_PROGRESS for 2s [ 1139.012401] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70472fc2-8f2e-4656-96c9-97081b657aa2: rpc.has_security_group_logging(os_id): False [ 1139.029439] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.029694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.029836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.030079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.048596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.048925] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.049105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.049226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.049454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.049549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.049646] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 is going to be updated. [ 1139.127188] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.127188] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.127188] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.127579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.127690] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.127840] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 2d0d656c-b406-4bdc-895f-873cc3d5f874 not found, creating... [ 1139.128209] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.128439] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.128614] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.128880] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.129035] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.129360] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.129546] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.129740] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.130014] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.130189] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.130357] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 is going to be created. [ 1139.142994] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.143203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.143300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.143505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.143717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.145186] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.145334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.145406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.145617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.145741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.145886] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb is going to be created. [ 1139.154625] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.154919] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.155146] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.155396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.155625] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.155852] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.161618] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: IN_PROGRESS for 2s [ 1139.172834] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.172984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.173076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.173385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.173636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.182777] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f0aee-549d-426e-90a7-d029d63ed8eb in Status: UNINITIALIZED for 2s [ 1139.265643] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.769448] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.893818] env[69847]: INFO networking_nsxv3.common.synchronization [req-8fcafdeb-ad24-4a25-8a01-2bc737087444 req-ee459bc7-2ff2-48a7-85f3-e3080c6240df service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1139.894042] env[69847]: INFO networking_nsxv3.common.synchronization [req-8fcafdeb-ad24-4a25-8a01-2bc737087444 req-ee459bc7-2ff2-48a7-85f3-e3080c6240df service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1139.894229] env[69847]: INFO networking_nsxv3.common.synchronization [req-8fcafdeb-ad24-4a25-8a01-2bc737087444 req-ee459bc7-2ff2-48a7-85f3-e3080c6240df service nova] Enqueued Resource ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 with Priority: HIGHEST for action port [ 1139.894760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1139.894904] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1139.897033] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 with Priority: HIGHEST for action port [ 1139.897033] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.897033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.897190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.897299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.897379] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.898415] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.898415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.898415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.898557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.900754] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.900930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.901050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.901253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.901442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.901585] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.902369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d0d656c-b406-4bdc-895f-873cc3d5f874 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.905767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.905929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.906098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.906147] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0d656c-b406-4bdc-895f-873cc3d5f874',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.273976] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.273976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.273976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.273976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.273976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.273976] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1140.300241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.300469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.300469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.300676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.300857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.311659] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1140.411395] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.412791] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.413036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.413901] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d0d656c-b406-4bdc-895f-873cc3d5f874 with status ACTIVE [ 1140.414038] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.414166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.414238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.414445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.422939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.425873] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.426038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.430022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.430022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.430022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 is going to be updated. [ 1140.452697] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.452925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.452925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.453142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.453284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.453506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.704436] env[69847]: INFO networking_nsxv3.common.synchronization [req-479ba822-e42e-4018-9d0e-11bfca50c702 req-4508eb68-83b1-4b34-a8d9-86e07f9baf39 tempest-ServerRescueNegativeTestJSON-1951917753 tempest-ServerRescueNegativeTestJSON-1951917753-project-member] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 1140.705061] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGHEST for action security_group_members [ 1140.705421] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.705544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.705668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.705874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.706044] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.706168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.706262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.706423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.706510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.706605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.789406] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1140.789688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.931858] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.175801] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: SUCCESS [ 1141.176032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.193255] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f0aee-549d-426e-90a7-d029d63ed8eb in Status: SUCCESS [ 1141.193550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.193723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.193970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.194266] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.194472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.194572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.194739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.194856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.194983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.195173] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.209574] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.209745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.209801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.210459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.210459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.210459] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.210459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.210678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.210678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.210822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.210855] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be updated. [ 1141.248863] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.249104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.249104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.249318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.249463] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.259364] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: IN_PROGRESS for 2s [ 1141.434517] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.434809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.434809] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.434975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.435077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.435195] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1141.463117] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.463270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.463340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.463551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.463695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.474282] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1141.697401] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.203425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84f0aee-549d-426e-90a7-d029d63ed8eb: rpc.has_security_group_logging(os_id): False [ 1142.234594] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.234854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.234854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.235071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.235156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.235441] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.235565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.235626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.237057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.237057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.237057] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb is going to be created. [ 1142.305022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.305022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.305022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.305022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.305022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.315580] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84f0aee-549d-426e-90a7-d029d63ed8eb in Status: IN_PROGRESS for 2s [ 1142.320376] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1142.320617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.269591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa in Status: SUCCESS [ 1143.269955] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa deletion is rescheduled due to dependency. [ 1143.269955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.483026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.486048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.486048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.486048] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.988303] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.989450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.989545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.989774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.989958] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.990089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.990157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.990326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.990415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.990504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.990653] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.990747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.990807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.990948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.991099] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.991185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.991242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.991375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.991449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.991525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.991612] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.330416] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84f0aee-549d-426e-90a7-d029d63ed8eb in Status: SUCCESS [ 1144.330678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.494901] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 447511d4-51f2-4b25-94d1-cdabf552a536: rpc.has_security_group_logging(os_id): False [ 1144.514513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.514513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.514513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.514513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.514513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.514513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.514513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.514513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.516124] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.516124] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.516124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.516124] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be created. [ 1144.575251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.575251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.575251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.575251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.575251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.591351] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1145.702188] env[69847]: INFO networking_nsxv3.common.synchronization [req-9c62eae0-2427-49ec-977e-cb4ca8e94734 req-ee04cd53-c338-4aaf-9521-b344a9932b2c tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1145.702708] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1145.703034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.703156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.703208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.703389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.703531] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.703620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.704510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.704510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.704510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.704510] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.024794] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.025007] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.025146] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.025477] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.025738] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.025897] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.026031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.026280] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.026439] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.026653] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.026769] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.026878] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.026987] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.027109] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.027217] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.027353] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.046416] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.046626] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1146.046773] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.046943] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.047257] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.047567] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.047720] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.048062] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.048255] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe04ce0-2bf7-4783-afc8-93fa31d05eda',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.209305] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.209461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.209533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.209743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.209831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.210028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.210301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.210301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.210352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.210433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.210524] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be deleted. [ 1146.240273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.240418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.240486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.240802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.240903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.241010] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.550535] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.550692] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.550781] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.551093] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.551250] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.551408] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 8fe04ce0-2bf7-4783-afc8-93fa31d05eda not found, creating... [ 1146.551672] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.551894] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.552056] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.552314] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.552473] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.552792] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.553017] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.553316] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.553716] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.553884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.554090] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 8fe04ce0-2bf7-4783-afc8-93fa31d05eda is going to be created. [ 1146.572151] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.572356] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.573160] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.573160] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.573160] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.573479] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.611909] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1146.612157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.320513] env[69847]: INFO networking_nsxv3.common.synchronization [req-9c62eae0-2427-49ec-977e-cb4ca8e94734 req-a51c5e1f-af87-4cd5-869a-7a2f025e100a service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1147.321628] env[69847]: INFO networking_nsxv3.common.synchronization [req-9c62eae0-2427-49ec-977e-cb4ca8e94734 req-a51c5e1f-af87-4cd5-869a-7a2f025e100a service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1147.325022] env[69847]: INFO networking_nsxv3.common.synchronization [req-9c62eae0-2427-49ec-977e-cb4ca8e94734 req-a51c5e1f-af87-4cd5-869a-7a2f025e100a service nova] Enqueued Resource ID: 8fe04ce0-2bf7-4783-afc8-93fa31d05eda with Priority: HIGHEST for action port [ 1147.325022] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1147.325022] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1147.325022] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fe04ce0-2bf7-4783-afc8-93fa31d05eda with Priority: HIGHEST for action port [ 1147.325022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.325022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.325022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.325022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.325022] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.325022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.325664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.325857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.326152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.326416] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.326745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.326952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.327478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.327678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.327930] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.329170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.329448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.329667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.329945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.330212] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe04ce0-2bf7-4783-afc8-93fa31d05eda',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.581609] env[69847]: INFO networking_nsxv3.common.synchronization [None req-7d6e895b-4d3f-4988-8859-9283abb12c59 None None] Enqueued Resource ID: 82ab1891-2c69-41bb-8a81-72db01a47fd6 with Priority: HIGHEST for action port [ 1147.581896] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ab1891-2c69-41bb-8a81-72db01a47fd6 with Priority: HIGHEST for action port [ 1147.582474] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-82ab1891-2c69-41bb-8a81-72db01a47fd6 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.582600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82ab1891-2c69-41bb-8a81-72db01a47fd6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.582666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82ab1891-2c69-41bb-8a81-72db01a47fd6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.582924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82ab1891-2c69-41bb-8a81-72db01a47fd6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.583013] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ab1891-2c69-41bb-8a81-72db01a47fd6',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.832550] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.834110] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.834232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.834958] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fe04ce0-2bf7-4783-afc8-93fa31d05eda with status ACTIVE [ 1147.834958] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.834958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.834958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.834958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.835212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.835260] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.835384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.835453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.835602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.835736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.835878] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.835970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.836076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.836375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.836375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.836375] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fe04ce0-2bf7-4783-afc8-93fa31d05eda is going to be updated. [ 1147.861702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.861702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.861702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.861863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.862070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.862187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fe04ce0-2bf7-4783-afc8-93fa31d05eda" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.085454] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82ab1891-2c69-41bb-8a81-72db01a47fd6 [ 1148.085708] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.085840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.085905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.086710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.086710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.086710] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82ab1891-2c69-41bb-8a81-72db01a47fd6 already deleted. [ 1148.086710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82ab1891-2c69-41bb-8a81-72db01a47fd6" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.108470] env[69847]: INFO networking_nsxv3.common.synchronization [None req-a429e8ea-a4ef-43e4-a5ea-20045a49c99e tempest-ServersTestBootFromVolume-1453441310 tempest-ServersTestBootFromVolume-1453441310-project-member] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_rules [ 1148.109050] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_rules [ 1148.109344] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.109465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.109531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.110357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.110357] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.274463] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b15ba3ae-7e78-4201-8b8c-16dbca414f2a tempest-ServersTestBootFromVolume-1453441310 tempest-ServersTestBootFromVolume-1453441310-project-member] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_rules [ 1148.275252] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_rules [ 1148.276177] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.276575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.339123] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.632229] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.632229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.632229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.632356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.632423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.632542] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd already deleted. [ 1148.632629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.632773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.632930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.633013] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.843688] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.843879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.843979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.844234] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.844359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.844491] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be created. [ 1148.870798] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.871085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.871085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.871224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.871402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.882889] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: UNINITIALIZED for 2s [ 1149.158199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.158199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.158199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.158199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.158199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.158199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd already deleted. [ 1149.158199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.900701] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d6aa3907-2c6a-4d91-a07a-28cbf5b1f73b None None] Enqueued Resource ID: 75c7f91a-460f-43f3-b876-a163b99f6f20 with Priority: HIGHEST for action port [ 1149.901249] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75c7f91a-460f-43f3-b876-a163b99f6f20 with Priority: HIGHEST for action port [ 1149.901545] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-75c7f91a-460f-43f3-b876-a163b99f6f20 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.901732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75c7f91a-460f-43f3-b876-a163b99f6f20" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.901732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75c7f91a-460f-43f3-b876-a163b99f6f20" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.901974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75c7f91a-460f-43f3-b876-a163b99f6f20" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.905156] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75c7f91a-460f-43f3-b876-a163b99f6f20',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.408129] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75c7f91a-460f-43f3-b876-a163b99f6f20 [ 1150.408367] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.408492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.408556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.408770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.408856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.408947] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75c7f91a-460f-43f3-b876-a163b99f6f20 already deleted. [ 1150.409035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75c7f91a-460f-43f3-b876-a163b99f6f20" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.892270] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1150.892270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.892270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.892478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.892694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.892817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.892886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.893066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.893165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.893257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.893350] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.396043] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.396456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.396456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.396547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.396651] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.396750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.396814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.396956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.398142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.398142] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.398142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.398709] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.900650] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa82bf-be1b-4e2a-9d96-94b63738ba8c: rpc.has_security_group_logging(os_id): False [ 1151.929493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.929707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.929707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.929972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.930064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.930222] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.930320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.930381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.930527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.930601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.930770] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.930860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.930915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.931163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.931244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.931425] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.931516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.931569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.931707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.931779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.932205] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be created. [ 1151.994647] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.994865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.994923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.995119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.995462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.014967] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1152.884267] env[69847]: INFO networking_nsxv3.common.synchronization [req-62684f7c-fd58-42a0-9767-ea0e2d6500ac req-cb1778a0-0753-4bbd-a839-ad40d6148d6d tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1152.884588] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1152.884963] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.885133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.885203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.885518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.885660] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.885760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.885816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.885967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.886059] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.886231] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.182389] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.182389] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.182389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.182389] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.182389] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.182389] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.182389] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.183402] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.183402] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.183402] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.223752] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.225489] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.225489] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.225489] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-229" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.225489] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.225489] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.225489] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.225793] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.225906] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b8a44b0-09be-4682-b1fe-7c47bd7194fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.389088] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.389254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.389254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.389424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.413364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.413538] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.413656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.413724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.413920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.414008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.414111] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1153.440341] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.440508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.440554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.440775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.440897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.448851] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1153.729165] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.729427] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.729559] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.729840] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.729989] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.730162] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 2b8a44b0-09be-4682-b1fe-7c47bd7194fa not found, creating... [ 1153.730421] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.730581] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.730701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.730923] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.731075] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.731354] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.731511] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.731630] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.731831] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.731965] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.732115] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 2b8a44b0-09be-4682-b1fe-7c47bd7194fa is going to be created. [ 1153.749622] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.749805] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.749927] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.750241] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.750474] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.750693] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.028533] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1154.028900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.462143] env[69847]: INFO networking_nsxv3.common.synchronization [req-62684f7c-fd58-42a0-9767-ea0e2d6500ac req-fd451893-7d1e-42d8-9ff7-2e9c0963170b service nova] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_rules [ 1154.462267] env[69847]: INFO networking_nsxv3.common.synchronization [req-62684f7c-fd58-42a0-9767-ea0e2d6500ac req-fd451893-7d1e-42d8-9ff7-2e9c0963170b service nova] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1154.462442] env[69847]: INFO networking_nsxv3.common.synchronization [req-62684f7c-fd58-42a0-9767-ea0e2d6500ac req-fd451893-7d1e-42d8-9ff7-2e9c0963170b service nova] Enqueued Resource ID: 2b8a44b0-09be-4682-b1fe-7c47bd7194fa with Priority: HIGHEST for action port [ 1154.463182] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_rules [ 1154.463346] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1154.463432] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b8a44b0-09be-4682-b1fe-7c47bd7194fa with Priority: HIGHEST for action port [ 1154.463772] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.465581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.465581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.465581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.465581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.466724] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.466876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.467172] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.467297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.467373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.467590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.469848] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b8a44b0-09be-4682-b1fe-7c47bd7194fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.970488] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.970488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.970488] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b8a44b0-09be-4682-b1fe-7c47bd7194fa with status ACTIVE [ 1154.970706] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.970706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.970800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.971019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.971117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.971288] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.971388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.971448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.971603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.971679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.971863] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.971959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.972037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.972190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.972266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.972349] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b8a44b0-09be-4682-b1fe-7c47bd7194fa is going to be updated. [ 1154.991882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.992055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.992120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.992327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.992527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.992611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b8a44b0-09be-4682-b1fe-7c47bd7194fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.246976] env[69847]: INFO networking_nsxv3.common.synchronization [req-4ca22dfb-c6bc-45b8-b342-8b9e4fc3a471 req-8de54682-80ec-4ec7-a987-22422107bb56 tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1155.247493] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1155.247797] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.247933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.247986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.249913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.250059] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.250175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.250250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.250505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.250505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.250610] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.458447] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1155.458671] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 deletion is rescheduled due to dependency. [ 1155.458753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.458950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.459119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.459485] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.459485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.459485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.459678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.459678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.459990] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.529403] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.529625] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.529727] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.529974] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.530236] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.530400] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.530525] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.530749] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.530893] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.531557] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.531705] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.531823] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.531940] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.532425] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.532425] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.532425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.548654] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.548824] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1155.549052] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.549242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-668" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.549549] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3f1482f6-c8bd-4244-ab13-c6449ea49875 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.549758] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.549859] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.550187] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.550327] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f1482f6-c8bd-4244-ab13-c6449ea49875',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.754612] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.962336] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.053390] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.053579] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.053691] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.054036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.054202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.054395] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3f1482f6-c8bd-4244-ab13-c6449ea49875 not found, creating... [ 1156.054671] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.054834] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.054954] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.055197] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.055362] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.055652] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.055812] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.055932] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.056157] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.056291] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.056453] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3f1482f6-c8bd-4244-ab13-c6449ea49875 is going to be created. [ 1156.075073] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.075303] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.075462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.075718] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.075945] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.076188] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.257170] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.465067] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.745957] env[69847]: INFO networking_nsxv3.common.synchronization [req-4ca22dfb-c6bc-45b8-b342-8b9e4fc3a471 req-d113eb37-0d17-4cb1-bfec-eecddc1379ce service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1156.746066] env[69847]: INFO networking_nsxv3.common.synchronization [req-4ca22dfb-c6bc-45b8-b342-8b9e4fc3a471 req-d113eb37-0d17-4cb1-bfec-eecddc1379ce service nova] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1156.746210] env[69847]: INFO networking_nsxv3.common.synchronization [req-4ca22dfb-c6bc-45b8-b342-8b9e4fc3a471 req-d113eb37-0d17-4cb1-bfec-eecddc1379ce service nova] Enqueued Resource ID: 3f1482f6-c8bd-4244-ab13-c6449ea49875 with Priority: HIGHEST for action port [ 1156.746712] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_rules [ 1156.746857] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1156.746949] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f1482f6-c8bd-4244-ab13-c6449ea49875 with Priority: HIGHEST for action port [ 1156.747247] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.747368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.747431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.747629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.747700] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.748608] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.748703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.748903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f1482f6-c8bd-4244-ab13-c6449ea49875 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.749013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.749077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.749253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.749420] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f1482f6-c8bd-4244-ab13-c6449ea49875',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.759304] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.759423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.759496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.759670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.759760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.760066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1156.786882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.786971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.787021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.787204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.787349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.794951] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1156.969162] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.969332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.969370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.969578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.969693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.969774] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1156.995803] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.996035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.996035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.999490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.999490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.004477] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1157.251311] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f1482f6-c8bd-4244-ab13-c6449ea49875 with status ACTIVE [ 1157.251624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.251796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.251900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.252207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.252304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.252547] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.252695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.252782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.252963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.253138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.253380] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.253486] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.253591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.253773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.253870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.253998] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f1482f6-c8bd-4244-ab13-c6449ea49875 is going to be updated. [ 1157.255178] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.255326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.278324] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.278620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.278620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.280428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.280428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.280428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f1482f6-c8bd-4244-ab13-c6449ea49875" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.284842] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.285080] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.285354] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.285761] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.286267] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.286566] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.286785] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.287092] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.287331] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.287643] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.287740] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.287857] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.287971] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.288101] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.288224] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.288362] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.313359] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.313568] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.313762] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.313990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-300" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.314371] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-2d0d656c-b406-4bdc-895f-873cc3d5f874 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.314604] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.314740] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.315133] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.315368] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0d656c-b406-4bdc-895f-873cc3d5f874',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.817694] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.817952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.818059] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.818350] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.818512] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.818818] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.818994] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.819126] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.819355] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.819498] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.819782] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.819939] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.820076] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.820293] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.820433] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.820578] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 is going to be updated. [ 1157.840443] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.840640] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.840761] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.841026] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.841221] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.841445] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.521706] env[69847]: INFO networking_nsxv3.common.synchronization [req-19a2a093-ddc7-4d20-aad8-a09a870b2aca req-a8007af3-b630-4c08-96d0-6310d38bbbee service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1158.521926] env[69847]: INFO networking_nsxv3.common.synchronization [req-19a2a093-ddc7-4d20-aad8-a09a870b2aca req-a8007af3-b630-4c08-96d0-6310d38bbbee service nova] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1158.522247] env[69847]: INFO networking_nsxv3.common.synchronization [req-19a2a093-ddc7-4d20-aad8-a09a870b2aca req-a8007af3-b630-4c08-96d0-6310d38bbbee service nova] Enqueued Resource ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 with Priority: HIGHEST for action port [ 1158.522823] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_rules [ 1158.523635] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1158.523635] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 with Priority: HIGHEST for action port [ 1158.523635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.523635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.523635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.524206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.524206] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.525990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.525990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.525990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.525990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.525990] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.525990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.526551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.526551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.526551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.526681] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.528487] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d0d656c-b406-4bdc-895f-873cc3d5f874 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.528487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.528487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.528487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.528487] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d0d656c-b406-4bdc-895f-873cc3d5f874',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.804019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1158.804242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.804406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.804616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.804799] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.804911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.804977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.805144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.805224] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.805343] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.013706] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1159.013901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.014115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.014341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.014570] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.014711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.014920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.015027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.015060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.015145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.015236] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.028437] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.029895] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d0d656c-b406-4bdc-895f-873cc3d5f874 with status ACTIVE [ 1159.030111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.030245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.030319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.030516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.030619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.030792] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.030886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.030944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.031141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.031219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.031451] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.031501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.031571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.031683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.031755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.031836] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d0d656c-b406-4bdc-895f-873cc3d5f874 is going to be updated. [ 1159.033995] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.033995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.052860] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.052985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.053068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.053261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.053400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.053552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d0d656c-b406-4bdc-895f-873cc3d5f874" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.307743] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.517917] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.518117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.518162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.518376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.518548] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.518636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.518684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.518831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.518917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.519021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.519163] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.519253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.519313] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.519449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.519583] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.519671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.519730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.519860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.519931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.520016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.520106] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.530389] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.811482] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.022766] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50dc186b-34b2-45b3-89b7-2dfa7346dc41: rpc.has_security_group_logging(os_id): False [ 1160.033014] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.033179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.033299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.033485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.033581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.033697] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1160.040557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.040742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.040789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.040976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.041078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.041289] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.041397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.041464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.041643] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.041723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.041909] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.042008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.042076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.042218] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.042303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.042501] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.042596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.042655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.042795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.042870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.042952] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1160.062865] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.062993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.063044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.063230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.063376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.070761] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1160.101171] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.101426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.101426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.101612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.101786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.122271] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1160.313746] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.313907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.313983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.314250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.314372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.314475] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1160.343447] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.343590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.343632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.343839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.344528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.353891] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1162.080135] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1162.080455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.080500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.080710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.080893] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.081013] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.081079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.081229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.081307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.081480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.081480] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.136031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1162.136225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.176837] env[69847]: INFO networking_nsxv3.common.synchronization [req-688c1191-fd14-4a26-b56e-5b27fc774770 req-a199f3c1-39b6-42a7-8cb7-6729aef2d8a5 tempest-ServerRescueTestJSON-1705482383 tempest-ServerRescueTestJSON-1705482383-project-member] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1162.177360] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1162.177695] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.177821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.177892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.178209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.178373] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.178474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.178539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.178693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.178777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.178865] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.364239] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1162.364585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.364836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.365163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.365446] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.365623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.365723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.365945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.366082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.366212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.366344] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.583566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.583725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.583796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.584050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.584217] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.584318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.584382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.584535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.584622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.584707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.584882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.584964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.585008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.585139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.585274] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.585401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.585509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.585579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.585650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.585732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.585818] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.681803] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.868464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.868660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.868741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.868897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.869081] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.869182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.869242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.869387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.869474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.869563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.869719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.869813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.869887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.870073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.870213] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.870304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.870363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.870510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.870582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.870651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.870738] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.088405] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 447511d4-51f2-4b25-94d1-cdabf552a536: rpc.has_security_group_logging(os_id): False [ 1163.107276] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.107435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.107435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.108191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.108191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.108191] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.108191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.108477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.108477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.108477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.108642] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.108773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.108842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.108984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.109070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.109258] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.109790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.109790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.109790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.109790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.109790] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1163.173135] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.173489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.173611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.173834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.173994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.183015] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.189660] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1163.373621] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8f57242-fc73-4330-af5c-da599a57f0de: rpc.has_security_group_logging(os_id): False [ 1163.417900] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.418126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.418179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.418386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.418477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.418674] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.418770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.418851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.419068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.419150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.419360] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.419456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.419513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.419653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.419724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.419905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.419995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.420069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.420202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.420274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.420357] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1163.500312] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.500503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.500503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.500721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.500866] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.522802] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1163.686145] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.686296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.686361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.686580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.686673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.686769] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be updated. [ 1163.718413] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.718546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.718779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.718872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.718955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.727075] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: IN_PROGRESS for 2s [ 1163.829370] env[69847]: INFO networking_nsxv3.common.synchronization [req-eedae3ee-31d6-42f8-9cdd-9de30fd8669a req-f8c0838e-7bd6-4b47-aff2-a9920568848c tempest-ImagesOneServerNegativeTestJSON-2032475179 tempest-ImagesOneServerNegativeTestJSON-2032475179-project-member] Enqueued Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1163.829370] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 with Priority: HIGHEST for action security_group_members [ 1163.829645] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-50dc186b-34b2-45b3-89b7-2dfa7346dc41 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.829808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.829896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.830147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.830342] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.830489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.830586] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.830769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.830882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.830990] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50dc186b-34b2-45b3-89b7-2dfa7346dc41',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.333317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.333317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.333317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.333715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.333715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.333715] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.333846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.333846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.334009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.334091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.334178] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 is going to be updated. [ 1164.368095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.368244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.368312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.368759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.368923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.376385] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: IN_PROGRESS for 2s [ 1165.216437] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1165.216437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.540786] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1165.541091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.736097] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1165.736308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.385189] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 in Status: SUCCESS [ 1166.385367] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50dc186b-34b2-45b3-89b7-2dfa7346dc41 deletion is rescheduled due to dependency. [ 1166.385516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50dc186b-34b2-45b3-89b7-2dfa7346dc41" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.798159] env[69847]: INFO networking_nsxv3.common.synchronization [req-ac351c93-d856-43a0-941e-59a89ea7f973 req-1690a347-debe-40cd-bcb4-ab62195e91bc tempest-ServerRescueTestJSON-1705482383 tempest-ServerRescueTestJSON-1705482383-project-member] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1168.798661] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGHEST for action security_group_members [ 1168.798965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.799103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.799166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.799357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.799821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.799929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.799994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.800162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.800248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.800340] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.302436] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.302630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.302691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.302947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.303061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.303291] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.303420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.303490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.303683] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.303769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.303860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be updated. [ 1169.333951] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.334088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.334163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.334372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.334508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.343821] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: IN_PROGRESS for 2s [ 1169.978694] env[69847]: INFO networking_nsxv3.common.synchronization [req-e1cb67eb-1b48-42f6-bc77-610ff3506a75 req-e0c0f1ea-61db-409f-a3bc-d25b832a845d tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1169.980829] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1169.980829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.980829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.980829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.980829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.980829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.981431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.981568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.981708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.981897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.982031] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.288101] env[69847]: INFO networking_nsxv3.common.synchronization [req-3f56aeef-578c-49e3-a314-7cba94193ecc req-87f106f2-50e5-4994-b10c-b67529df6805 tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1170.289904] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1170.289904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.289904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.289904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.290771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.290771] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.290771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.290771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.291587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.291587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.291587] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.485109] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.795066] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.795232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.795303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.795609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.795710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.795950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.796069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.796133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.796320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.796402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.796489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1170.821190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.821331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.821408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.821595] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.821765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.829802] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1170.987814] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.354695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 777d5afe-018d-46de-82b7-4dde124236a9 in Status: SUCCESS [ 1171.354695] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 deletion is rescheduled due to dependency. [ 1171.354695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.490768] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.490941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.490983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.491214] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.491303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.491400] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1171.520897] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.521058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.521132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.521340] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.521488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.529421] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1172.468749] env[69847]: INFO networking_nsxv3.common.synchronization [None req-0f0ad3ab-6513-4b90-ba81-b479ee50ad58 None None] Enqueued Resource ID: 5fb93e49-ea45-4bec-a7d3-0b262a15672d with Priority: HIGHEST for action port [ 1172.469558] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb93e49-ea45-4bec-a7d3-0b262a15672d with Priority: HIGHEST for action port [ 1172.469895] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fb93e49-ea45-4bec-a7d3-0b262a15672d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.470394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fb93e49-ea45-4bec-a7d3-0b262a15672d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.470855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fb93e49-ea45-4bec-a7d3-0b262a15672d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.471287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fb93e49-ea45-4bec-a7d3-0b262a15672d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.475022] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb93e49-ea45-4bec-a7d3-0b262a15672d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.840026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1172.840026] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1172.840199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.977228] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fb93e49-ea45-4bec-a7d3-0b262a15672d [ 1172.977468] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.978190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.978190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.978190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.978190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.978190] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fb93e49-ea45-4bec-a7d3-0b262a15672d already deleted. [ 1172.978190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fb93e49-ea45-4bec-a7d3-0b262a15672d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.538304] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1173.538630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.732090] env[69847]: INFO networking_nsxv3.common.synchronization [None req-5e731f05-d52d-493d-a93e-1df9b3f1082a None None] Enqueued Resource ID: e5f3d831-5ee8-4403-803c-d87868e2e962 with Priority: HIGHEST for action port [ 1174.732444] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5f3d831-5ee8-4403-803c-d87868e2e962 with Priority: HIGHEST for action port [ 1174.732931] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5f3d831-5ee8-4403-803c-d87868e2e962 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.733068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5f3d831-5ee8-4403-803c-d87868e2e962" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.733136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5f3d831-5ee8-4403-803c-d87868e2e962" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.733390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5f3d831-5ee8-4403-803c-d87868e2e962" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.733466] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5f3d831-5ee8-4403-803c-d87868e2e962',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.242998] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5f3d831-5ee8-4403-803c-d87868e2e962 [ 1175.242998] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.242998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.242998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.242998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.242998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.242998] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5f3d831-5ee8-4403-803c-d87868e2e962 already deleted. [ 1175.242998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5f3d831-5ee8-4403-803c-d87868e2e962" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.833970] env[69847]: INFO networking_nsxv3.common.synchronization [req-1ad006ac-3236-4613-bed3-f3344defe898 req-7112ecad-eea1-400c-b1ae-3dcfb22a39af tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1175.834461] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1175.834763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.834875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.834933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.835237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.835802] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.835955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.836062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.836258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.836377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.836571] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.337864] env[69847]: INFO networking_nsxv3.common.synchronization [req-ba15ab78-2827-4079-a6ab-00e75904607c req-0a595952-a264-444d-a50a-ca122b935701 tempest-ServersTestBootFromVolume-1453441310 tempest-ServersTestBootFromVolume-1453441310-project-member] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_members [ 1176.338177] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.339242] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_members [ 1176.339890] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.339890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.339890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.340191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.340312] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.340413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.340522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.340618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.340702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.340783] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.646092] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.646249] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-287" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.646249] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-287" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.646618] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-287" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.646879] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.647051] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.647173] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.647645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.647645] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.647761] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.647849] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.647961] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.648080] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.648191] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1176.648297] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.648429] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.667280] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.667280] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1176.667534] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.667534] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-287" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.667766] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-63d482aa-95df-4804-aac1-b2416a5f602a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.667934] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.668066] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.668376] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.668519] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63d482aa-95df-4804-aac1-b2416a5f602a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.840717] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.843337] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.843546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.843611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.843786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.843873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.844061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.844160] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.844213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.844366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.844437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.844531] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd already deleted. [ 1176.844630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.171769] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.171769] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.171769] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.171769] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.171769] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.172151] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 63d482aa-95df-4804-aac1-b2416a5f602a not found, creating... [ 1177.172151] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.172296] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.172409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.172629] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.172762] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.173050] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.173201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.173314] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.173540] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.173669] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.173804] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 63d482aa-95df-4804-aac1-b2416a5f602a is going to be created. [ 1177.192038] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.192177] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.192216] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.192443] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.192677] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.192893] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.343359] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.343533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.343603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.343881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.344009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.344140] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be updated. [ 1177.379204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.379308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.379384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.379602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.379757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.388123] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: IN_PROGRESS for 2s [ 1177.874619] env[69847]: INFO networking_nsxv3.common.synchronization [req-ba15ab78-2827-4079-a6ab-00e75904607c req-ee0ae168-4cd3-4f36-9e77-e68f5dd9e032 service nova] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_rules [ 1177.874865] env[69847]: INFO networking_nsxv3.common.synchronization [req-ba15ab78-2827-4079-a6ab-00e75904607c req-ee0ae168-4cd3-4f36-9e77-e68f5dd9e032 service nova] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_members [ 1177.875951] env[69847]: INFO networking_nsxv3.common.synchronization [req-ba15ab78-2827-4079-a6ab-00e75904607c req-ee0ae168-4cd3-4f36-9e77-e68f5dd9e032 service nova] Enqueued Resource ID: 63d482aa-95df-4804-aac1-b2416a5f602a with Priority: HIGHEST for action port [ 1177.876283] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_rules [ 1177.876423] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_members [ 1177.876575] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63d482aa-95df-4804-aac1-b2416a5f602a with Priority: HIGHEST for action port [ 1177.876878] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.877032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.877106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.877301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.877380] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.878293] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.878407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.878407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.878551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.878725] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.878794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.878843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.878967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.879054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.879143] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.879848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-63d482aa-95df-4804-aac1-b2416a5f602a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.880175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.880175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.881066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.881066] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63d482aa-95df-4804-aac1-b2416a5f602a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.383328] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.384506] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.384651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.385521] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63d482aa-95df-4804-aac1-b2416a5f602a with status ACTIVE [ 1178.385521] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.385521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.385521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.385521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.385521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.385872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.385872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.385872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.385995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.386033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.386210] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.386300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.386358] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.386862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.386862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.386862] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63d482aa-95df-4804-aac1-b2416a5f602a is going to be updated. [ 1178.407185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.407185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.407311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.407433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.407542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.407660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63d482aa-95df-4804-aac1-b2416a5f602a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.888922] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.393972] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.394136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.394203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.394500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.394500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.394636] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd is going to be created. [ 1179.397644] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1179.397839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.418034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.418034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.418034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.418264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.418264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.426265] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd in Status: UNINITIALIZED for 2s [ 1180.585248] env[69847]: INFO networking_nsxv3.common.synchronization [req-63a269da-7bf9-41e4-a7bb-aecdee2060b7 req-5b7d2604-18e2-443a-a8c0-c840898e615b tempest-ServersTestJSON-1772580768 tempest-ServersTestJSON-1772580768-project-member] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1180.586444] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGHEST for action security_group_members [ 1180.586444] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.586444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.586444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.586700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.586854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.586922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.586994] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.587169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.587310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.587367] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.092873] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.092873] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.092873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.092873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be updated. [ 1181.120130] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.120130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.120130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.121226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.123039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.136480] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: IN_PROGRESS for 2s [ 1181.205847] env[69847]: INFO networking_nsxv3.common.synchronization [req-fb4d3b28-40af-4a23-85eb-86fc56b01d2f req-6d1becd0-d5dd-42d1-b448-908d06df3201 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_members [ 1181.206397] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGHEST for action security_group_members [ 1181.206806] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.206929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.206991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.207198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.207349] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.207440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.207499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.207637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.207716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.207804] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.437674] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd in Status: SUCCESS [ 1181.437949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.438221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.438450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.438641] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.438763] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.438822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.438996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.439200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.439314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.439408] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.713201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.713572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.713572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.713653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.713743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.713952] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.714060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.714119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.714268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.714344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.714431] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e98e92-8284-4e76-b863-496da25fff54 is going to be updated. [ 1181.745829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.746055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.746055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.746273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.746417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.756462] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: IN_PROGRESS for 2s [ 1181.942017] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.446830] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a84f4511-52a2-43f2-996e-119d1f5c4dbd: rpc.has_security_group_logging(os_id): False [ 1182.469115] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.469368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.469448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.469758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.470011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.470411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.470576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.470744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.471070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.471219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.471366] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd is going to be created. [ 1182.533571] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.533571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.533571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.533791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.533980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.556325] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd in Status: IN_PROGRESS for 2s [ 1183.144087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8f57242-fc73-4330-af5c-da599a57f0de in Status: SUCCESS [ 1183.144377] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8f57242-fc73-4330-af5c-da599a57f0de deletion is rescheduled due to dependency. [ 1183.144377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.787946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e98e92-8284-4e76-b863-496da25fff54 in Status: SUCCESS [ 1183.788206] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e98e92-8284-4e76-b863-496da25fff54 deletion is rescheduled due to dependency. [ 1183.788328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.505089] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c57356e-5551-4e20-beb4-046c3623da8c req-64c866c3-377e-4f68-b0b8-0ed959fba274 tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1184.505280] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1184.505538] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.505681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.505752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.506018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.506475] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.506587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.506674] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.506850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.506932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.507033] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.569255] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd in Status: SUCCESS [ 1184.569471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.756794] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.757027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.757160] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.757501] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.757770] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.757929] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.758069] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.758292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.758442] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.758655] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.758766] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.758874] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.758983] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.759104] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.759213] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.759343] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.778470] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.778634] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.778775] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.778940] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.779246] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-bf2eb37a-70ff-4079-a196-3015a63f5b53 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.779412] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.779530] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.779818] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.779958] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2eb37a-70ff-4079-a196-3015a63f5b53',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.009564] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.009777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.009842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.010034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.010129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.010321] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.010424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.010480] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.010631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.010706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.010789] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 already deleted. [ 1185.010870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.283036] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.283036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.283036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.283036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.283309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.283353] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port bf2eb37a-70ff-4079-a196-3015a63f5b53 not found, creating... [ 1185.283640] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.283808] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.283953] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.284232] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.284407] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.284728] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.284911] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.285057] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.285303] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.285466] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.285665] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: bf2eb37a-70ff-4079-a196-3015a63f5b53 is going to be created. [ 1185.306594] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.306859] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.306996] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.307312] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.307749] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.307857] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.989221] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c57356e-5551-4e20-beb4-046c3623da8c req-edb2bd00-4194-4f12-aad0-303c01ef0b07 service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1185.989485] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c57356e-5551-4e20-beb4-046c3623da8c req-edb2bd00-4194-4f12-aad0-303c01ef0b07 service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1185.989615] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c57356e-5551-4e20-beb4-046c3623da8c req-edb2bd00-4194-4f12-aad0-303c01ef0b07 service nova] Enqueued Resource ID: bf2eb37a-70ff-4079-a196-3015a63f5b53 with Priority: HIGHEST for action port [ 1185.989850] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1185.989980] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1185.990094] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf2eb37a-70ff-4079-a196-3015a63f5b53 with Priority: HIGHEST for action port [ 1185.990622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.990760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.990813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.991074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.991158] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.991937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.992544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.992544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.992544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.992544] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.992544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.992544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.992800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.992800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.992903] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.993708] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf2eb37a-70ff-4079-a196-3015a63f5b53 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.993708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.993708] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.993852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.994076] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2eb37a-70ff-4079-a196-3015a63f5b53',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.499559] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.499693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.499873] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.500771] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf2eb37a-70ff-4079-a196-3015a63f5b53 with status ACTIVE [ 1186.500950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.501075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.501139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.501344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.501435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.501605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.501701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.501768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.501916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.502395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.502395] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.502395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.502395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.502617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.502617] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.502617] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf2eb37a-70ff-4079-a196-3015a63f5b53 is going to be updated. [ 1186.527853] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.528081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.528193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.528518] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.528771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.528999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf2eb37a-70ff-4079-a196-3015a63f5b53" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.004774] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.507648] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.507806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.507889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.508622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.508622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.508622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be created. [ 1187.532573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.532741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.532848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.533067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.533226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.543462] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: UNINITIALIZED for 2s [ 1188.491591] env[69847]: INFO networking_nsxv3.common.synchronization [req-18b33419-cd11-4424-bc21-f6621fba51ac req-32ad4408-f205-45da-89ed-eb624e865412 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1188.492605] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGHEST for action security_group_members [ 1188.492605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.492758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.492758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.492985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.493446] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.494568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.494568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.494568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.494568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.494568] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.996296] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.996490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.996539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.996730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.021445] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.021969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.022167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.022289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.022562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.022658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.022776] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be updated. [ 1189.053202] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.053434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.053936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.054377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.054627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.069900] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: IN_PROGRESS for 2s [ 1189.551478] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1189.551751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.552186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.552186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.553694] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.553694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.553694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.553694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.553694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.553694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.553694] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.056362] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.056540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.056624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.056874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.057077] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.057233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.057293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.057420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.057530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.057638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.057763] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.057855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.057915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.058174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.058320] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.058413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.058471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.058608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.058699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.058795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.058881] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.404969] env[69847]: INFO networking_nsxv3.common.synchronization [req-05b78d8a-72a6-43a0-8b1a-b10fe03d2a9e req-589d5466-3f25-4199-803b-0f76684145ec tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1190.405930] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1190.405930] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.405930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.405930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.406245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.406245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.406245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.406392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.406437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.406522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.406625] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.561682] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20f5623-3d28-4e23-9c51-ff9f4ae3c707: rpc.has_security_group_logging(os_id): False [ 1190.578662] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.578799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.578855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.579079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.579164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.579376] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.579461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.579559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.579677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.579749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.579926] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.580029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.580116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.580264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.580335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.580505] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.580591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.580647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.580779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.580845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.583016] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be created. [ 1190.646442] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.646583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.646657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.646870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.647074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.656932] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1190.722691] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.722974] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.723158] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.727023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.727023] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.727023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.727023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.727023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.727023] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.727023] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.727023] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.727023] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.727023] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.727023] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.727023] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.727023] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.754297] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.754476] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.754646] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.754828] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.755213] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3606a100-73b2-4fb7-b769-14a7f2a81598 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.755395] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.755520] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.755921] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.756082] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3606a100-73b2-4fb7-b769-14a7f2a81598',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.909104] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.909252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.909316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.909542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.909631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.909836] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.909931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.909931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.910230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.910353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.910445] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1190.937053] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.937515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.937721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.938639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.938639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.946175] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1191.079719] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 in Status: SUCCESS [ 1191.080516] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 deletion is rescheduled due to dependency. [ 1191.080691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.261853] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.262030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.262130] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.262458] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.262623] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.262784] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3606a100-73b2-4fb7-b769-14a7f2a81598 not found, creating... [ 1191.263080] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.263252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.263378] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.263607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.263891] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.264335] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.264514] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.264637] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.264889] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.265040] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.265192] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3606a100-73b2-4fb7-b769-14a7f2a81598 is going to be created. [ 1191.283460] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.283708] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.283826] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.284125] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.284362] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.284755] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.492094] env[69847]: INFO networking_nsxv3.common.synchronization [req-05b78d8a-72a6-43a0-8b1a-b10fe03d2a9e req-fc354769-2c60-4788-aefe-55f069eb3516 service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1192.492374] env[69847]: INFO networking_nsxv3.common.synchronization [req-05b78d8a-72a6-43a0-8b1a-b10fe03d2a9e req-fc354769-2c60-4788-aefe-55f069eb3516 service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1192.492443] env[69847]: INFO networking_nsxv3.common.synchronization [req-05b78d8a-72a6-43a0-8b1a-b10fe03d2a9e req-fc354769-2c60-4788-aefe-55f069eb3516 service nova] Enqueued Resource ID: 3606a100-73b2-4fb7-b769-14a7f2a81598 with Priority: HIGHEST for action port [ 1192.492769] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1192.492847] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1192.492899] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3606a100-73b2-4fb7-b769-14a7f2a81598 with Priority: HIGHEST for action port [ 1192.493442] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.493570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.493624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.493828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.493910] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.494841] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.494841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.494993] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3606a100-73b2-4fb7-b769-14a7f2a81598 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.495105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.495168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.495332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.495401] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3606a100-73b2-4fb7-b769-14a7f2a81598',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.667604] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1192.667886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.956124] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1192.956295] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1192.956405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.956561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.956806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.956978] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.957105] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.957168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.957324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.957406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.957502] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.997309] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.997441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.997661] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3606a100-73b2-4fb7-b769-14a7f2a81598 with status ACTIVE [ 1192.997830] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.997962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.998183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.998653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.998879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.999700] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.999885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.999954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.000147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.000227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.000408] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.000502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.000557] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.000696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.000772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.000854] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3606a100-73b2-4fb7-b769-14a7f2a81598 is going to be updated. [ 1193.018809] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.018933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.019042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.019168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.019293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.019438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3606a100-73b2-4fb7-b769-14a7f2a81598" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.460706] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.598186] env[69847]: INFO networking_nsxv3.common.synchronization [req-b2cf330e-935e-4681-a00a-9a9dee1b1d75 req-f2f46972-398d-4e37-a92f-47953e04e9aa tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1193.599880] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGHEST for action security_group_members [ 1193.600735] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.601161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.601376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.604034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.604034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.604034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.604034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.604034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.604034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.604034] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.963309] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.064872] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6bf87e19-e06b-4557-80ae-50acd89e9894 tempest-AttachInterfacesTestJSON-720075495 tempest-AttachInterfacesTestJSON-720075495-project-member] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1194.065452] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGHEST for action security_group_members [ 1194.065838] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.066210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.066210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.066210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.066460] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.066606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.066712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.066914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.067036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.067155] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.106212] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.106365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.106442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.106660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.106929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.107181] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.107288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.107355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.107524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.107608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.107700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 is going to be updated. [ 1194.146217] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.146217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.146380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.146489] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.146637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.159348] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: IN_PROGRESS for 2s [ 1194.466723] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.466723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.466723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.466723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.466723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.466723] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1194.492332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.492332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.492332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.492332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.492332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.499815] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1194.569876] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.569995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.570087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.570300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.570390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.570590] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.570725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.570771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.570890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.570966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.571067] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be updated. [ 1194.727756] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.728104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.728104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.728226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.728320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.736757] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: IN_PROGRESS for 2s [ 1196.167934] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 in Status: SUCCESS [ 1196.168208] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 deletion is rescheduled due to dependency. [ 1196.168243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.508651] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1196.508923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.509051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.509300] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.509413] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.509558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.509627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.509717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.509803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.509870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.509984] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.745884] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447511d4-51f2-4b25-94d1-cdabf552a536 in Status: SUCCESS [ 1196.746152] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 deletion is rescheduled due to dependency. [ 1196.746292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.805836] env[69847]: INFO networking_nsxv3.common.synchronization [req-6029e884-faeb-45ef-9828-25bf2ec1fb36 req-7183dcaf-b404-479a-bfe8-2bcc7cc0fb93 tempest-AttachVolumeTestJSON-1596419864 tempest-AttachVolumeTestJSON-1596419864-project-member] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_members [ 1196.805836] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGHEST for action security_group_members [ 1196.805836] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.805836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.805836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.805836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.806163] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.806163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.806163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.806312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.806396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.806488] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.012741] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.013200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.013200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.013407] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.013590] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.013719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.013854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.014030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.014123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.014212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.014364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.014458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.014510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.014650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.014787] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.014875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.014931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.015072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.015145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.015223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.015310] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.309602] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.310112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.310112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.310355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.337266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.337266] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.337266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.337266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.337266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.337266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.337266] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 is going to be updated. [ 1197.377300] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.377494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.377494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.377714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.377854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.388111] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 in Status: IN_PROGRESS for 2s [ 1197.501604] env[69847]: INFO networking_nsxv3.common.synchronization [req-5aa91744-7b34-4548-9930-e3fd33bad04b req-905d278f-fb79-4a13-894e-fea6c4ad34c1 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1197.503593] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1197.503959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.504780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.504780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.504780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.504780] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.504780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.504780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.505067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.505101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.505220] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.518494] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa82bf-be1b-4e2a-9d96-94b63738ba8c: rpc.has_security_group_logging(os_id): False [ 1197.534851] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.536101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.536101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.536101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.536101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.536101] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.536101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.536101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.536419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.536419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.536484] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.536529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.537173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.537173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.537173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.537173] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.537173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.537173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.537404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.537404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.537456] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1197.602400] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.602542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.602601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.603069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.603069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.615027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1197.851024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.851024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.851024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.851024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.851024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.851024] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.854252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.854252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.854252] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.854409] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.856031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.856031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.856031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.856031] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.856031] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.856031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.873670] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.873840] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1197.873981] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.874184] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.874502] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.874673] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.874790] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.875135] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.875276] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.007261] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.008084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.008084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.008084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.008084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.008084] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.008441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.008441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.008441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.008441] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.008659] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be deleted. [ 1198.035923] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.036147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.036147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.036367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.036505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.036621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.380726] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.380726] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a not found, creating... [ 1198.380726] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.380726] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.381437] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.381437] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.381437] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.381611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.381802] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.381980] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a is going to be created. [ 1198.403386] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.403386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.403386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.403386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.403386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.403386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.951178] env[69847]: INFO networking_nsxv3.common.synchronization [None req-50e70f4e-2b9e-49de-8801-f7f39285b27a None None] Enqueued Resource ID: d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f with Priority: HIGHEST for action port [ 1198.951445] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f with Priority: HIGHEST for action port [ 1198.951998] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.952141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.952211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.952454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.952588] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.325099] env[69847]: INFO networking_nsxv3.common.synchronization [req-5aa91744-7b34-4548-9930-e3fd33bad04b req-51ecd356-6fd6-4534-9d4f-8fa1281ebd7f service nova] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_rules [ 1199.325099] env[69847]: INFO networking_nsxv3.common.synchronization [req-5aa91744-7b34-4548-9930-e3fd33bad04b req-51ecd356-6fd6-4534-9d4f-8fa1281ebd7f service nova] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1199.325099] env[69847]: INFO networking_nsxv3.common.synchronization [req-5aa91744-7b34-4548-9930-e3fd33bad04b req-51ecd356-6fd6-4534-9d4f-8fa1281ebd7f service nova] Enqueued Resource ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a with Priority: HIGHEST for action port [ 1199.325099] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_rules [ 1199.325614] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1199.325931] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a with Priority: HIGHEST for action port [ 1199.326373] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.326671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.326917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.327284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.327494] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.329439] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.329439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.329439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.329818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.330575] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.330575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.330575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.330575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.331075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.331370] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.332419] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.332957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.332957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.333890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.333890] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.398248] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 in Status: SUCCESS [ 1199.398567] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 deletion is rescheduled due to dependency. [ 1199.398567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.456864] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f [ 1199.456864] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.456864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.456864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.456864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.456864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.456864] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f already deleted. [ 1199.457198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d62b94ea-a03b-4a8a-90d4-4d6f88a03c0f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.631153] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1199.631374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.706321] env[69847]: INFO networking_nsxv3.common.synchronization [None req-cc4f5a46-eaec-4acf-9954-636a2c6d6281 tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1199.706844] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1199.707158] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.708319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.708319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.708319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.708319] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.795712] env[69847]: INFO networking_nsxv3.common.synchronization [None req-30301f8d-24c0-4caa-b94b-a2221294406a tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1199.796443] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1199.796764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.796884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.835433] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.836544] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.836653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.836812] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a with status ACTIVE [ 1199.836973] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.837089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.837152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.837352] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.837457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.837634] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.837730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.837795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.837945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.838037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.838235] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.838331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.838393] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.838533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.838606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.838691] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a is going to be updated. [ 1199.859845] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.860047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.860096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.860294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.860415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.860569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.231301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.231301] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc already deleted. [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.231301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.231301] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.340358] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.749808] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.749808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.749808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.749808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.749808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.749808] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc already deleted. [ 1200.749808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.843459] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.843459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.843459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.843459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.843459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.843459] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be created. [ 1200.866230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.866356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.866437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.866650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.866853] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.875146] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: UNINITIALIZED for 2s [ 1202.888377] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: SUCCESS [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.888377] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.888377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.888377] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.394563] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.394563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.394563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.394563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.394563] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.394563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.394563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.397446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.397605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.397605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.397782] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.398230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.398230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.398230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.398403] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.398468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.398663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.398663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.399433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.399433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.399433] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.903881] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e41d6c35-289a-46b1-9113-0dea949327e3: rpc.has_security_group_logging(os_id): False [ 1203.939317] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.939504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.939567] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.939799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.939896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.940215] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.940329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.940442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.940598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.940670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.940861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.940952] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.941173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.941173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.941316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.941414] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.941503] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.941555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.941701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.942280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.942280] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be created. [ 1204.012870] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.013035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.013110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.013348] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.013552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.026130] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: IN_PROGRESS for 2s [ 1204.284230] env[69847]: INFO networking_nsxv3.common.synchronization [None req-dbdbf2d1-db15-489f-b252-67473c990627 None None] Enqueued Resource ID: b0cdec0d-0548-466f-bd18-e9d0711226fe with Priority: HIGHEST for action port [ 1204.284594] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0cdec0d-0548-466f-bd18-e9d0711226fe with Priority: HIGHEST for action port [ 1204.285077] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0cdec0d-0548-466f-bd18-e9d0711226fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.285243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0cdec0d-0548-466f-bd18-e9d0711226fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.285296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0cdec0d-0548-466f-bd18-e9d0711226fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.285533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0cdec0d-0548-466f-bd18-e9d0711226fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.285614] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0cdec0d-0548-466f-bd18-e9d0711226fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.789009] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0cdec0d-0548-466f-bd18-e9d0711226fe [ 1204.789251] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.789381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.789450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.789844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.789957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.790075] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0cdec0d-0548-466f-bd18-e9d0711226fe already deleted. [ 1204.790165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0cdec0d-0548-466f-bd18-e9d0711226fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.343903] env[69847]: INFO networking_nsxv3.common.synchronization [req-16352285-6d34-4654-bb53-1e28f35359a7 req-381be863-ec41-4e95-8b20-1799444a5f9b tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1205.344509] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1205.344837] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.345125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.345185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.345462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.347012] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.347175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.347175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.347175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.347175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.347662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.851471] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.851644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.851737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.852027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.852178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.852363] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.852478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.852543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.852698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.852773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.852859] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1205.881781] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.881975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.882031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.882250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.882370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.890442] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1206.040731] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: SUCCESS [ 1206.040964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.325654] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8e095279-9f02-40d9-b75a-63afa553a8ed None None] Enqueued Resource ID: 0e6fd729-968c-46de-bcc3-b8f210e0b90d with Priority: HIGHEST for action port [ 1206.326595] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6fd729-968c-46de-bcc3-b8f210e0b90d with Priority: HIGHEST for action port [ 1206.326947] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e6fd729-968c-46de-bcc3-b8f210e0b90d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.330702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e6fd729-968c-46de-bcc3-b8f210e0b90d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.330792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e6fd729-968c-46de-bcc3-b8f210e0b90d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.331359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e6fd729-968c-46de-bcc3-b8f210e0b90d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.331359] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e6fd729-968c-46de-bcc3-b8f210e0b90d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.511624] env[69847]: INFO networking_nsxv3.common.synchronization [req-0019ffca-8b9e-4375-8306-3563cb731425 req-d23056ab-a8cb-4908-8fc5-54d75bcafbe7 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1206.511624] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGHEST for action security_group_members [ 1206.511624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.511624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.511624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.512340] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.551838] env[69847]: INFO networking_nsxv3.common.synchronization [req-0019ffca-8b9e-4375-8306-3563cb731425 req-d23056ab-a8cb-4908-8fc5-54d75bcafbe7 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a with Priority: HIGHEST for action port [ 1206.552326] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a with Priority: HIGHEST for action port [ 1206.552620] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.552739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.552804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.553008] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.553097] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.609058] env[69847]: INFO networking_nsxv3.common.synchronization [req-855358a2-94f5-471b-abbd-e91e207e6df7 req-bc2bb6c5-bf33-4673-a202-52c89e5b7797 tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1206.609058] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1206.609058] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.609058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.609279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.609383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.609511] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.609601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.609659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.609800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.609886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.609975] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.833694] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e6fd729-968c-46de-bcc3-b8f210e0b90d [ 1206.833946] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.834096] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.834162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.834410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.834504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.834607] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e6fd729-968c-46de-bcc3-b8f210e0b90d already deleted. [ 1206.834732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e6fd729-968c-46de-bcc3-b8f210e0b90d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.018923] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.022529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.022658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.022867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.022958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.023201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.023318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.023380] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.023529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.023601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.023693] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be updated. [ 1207.033519] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.033785] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.033785] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.034121] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.034393] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.034549] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.034672] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.034894] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.035057] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.035270] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.035386] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.035495] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.035607] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.035725] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.035905] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.035978] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.050774] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.050872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.050971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.051159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.051308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.054497] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.054666] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.054805] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.054968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.055313] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.055488] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.055617] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.055954] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.056110] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c280f7c-89df-44e1-b477-13a6e8bbdd5f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.056927] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a with status ACTIVE [ 1207.058197] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.058359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.058483] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.058568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.058628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.058795] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.058897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.058947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.059097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.059169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.059359] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.059451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.059500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.059789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.059789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.059789] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a is going to be updated. [ 1207.061175] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: IN_PROGRESS for 2s [ 1207.079639] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.079782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.079852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.080048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.080181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.080334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fd34a2d-cefe-48a6-81d8-4ccf6b4f0f8a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.112064] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.112221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.112297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.112524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.112614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.112813] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.112909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.112972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.113131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.113207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.113293] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc already deleted. [ 1207.113371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.563113] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.563451] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.563619] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.563974] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.564248] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.564502] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3c280f7c-89df-44e1-b477-13a6e8bbdd5f not found, creating... [ 1207.564868] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.565997] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.566309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.566427] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.566577] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.566882] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.567058] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.567180] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.567403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.567543] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.567685] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f is going to be created. [ 1207.584971] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.585212] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.585435] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.585607] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.585841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.586133] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.900957] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1207.901198] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1207.901280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.259906] env[69847]: INFO networking_nsxv3.common.synchronization [req-855358a2-94f5-471b-abbd-e91e207e6df7 req-ed6dd566-5e4a-4c68-b1f9-36e676f12448 service nova] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1208.260108] env[69847]: INFO networking_nsxv3.common.synchronization [req-855358a2-94f5-471b-abbd-e91e207e6df7 req-ed6dd566-5e4a-4c68-b1f9-36e676f12448 service nova] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1208.260257] env[69847]: INFO networking_nsxv3.common.synchronization [req-855358a2-94f5-471b-abbd-e91e207e6df7 req-ed6dd566-5e4a-4c68-b1f9-36e676f12448 service nova] Enqueued Resource ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f with Priority: HIGHEST for action port [ 1208.260489] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1208.260613] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1208.260706] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f with Priority: HIGHEST for action port [ 1208.261253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.261377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.261452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.261715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.261715] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.262674] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.262798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.262938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.263056] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.263227] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.263324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.263376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.263520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.263655] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.263702] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.264428] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.264539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.264593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.264757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.264826] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c280f7c-89df-44e1-b477-13a6e8bbdd5f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.767222] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.767882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.768200] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.769226] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c280f7c-89df-44e1-b477-13a6e8bbdd5f with status ACTIVE [ 1208.769427] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.769543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.769605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.769800] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.769890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.770074] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.770171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.770225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.770397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.770476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.770655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.770745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.770804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.770954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.771047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.771147] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f is going to be updated. [ 1208.793012] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.793173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.793213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.793409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.793542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.793691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.071700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e41d6c35-289a-46b1-9113-0dea949327e3 in Status: SUCCESS [ 1209.071891] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 deletion is rescheduled due to dependency. [ 1209.071977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.274018] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.777972] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.777972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.777972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.778399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.778443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.778759] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc is going to be created. [ 1209.800048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.800207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.800309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.800508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.800633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.813872] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: UNINITIALIZED for 2s [ 1211.826959] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: SUCCESS [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.826959] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.826959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.826959] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.906405] env[69847]: INFO networking_nsxv3.common.synchronization [req-19808fae-b51e-44e9-80c0-ba0912b260b2 req-1f5f3404-93b5-4a2b-bd7c-0e5d7497834d tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1211.907171] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1211.907487] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.907607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.907673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.907918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.908261] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.908383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.908448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.908607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.908693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.908787] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.327294] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.327422] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.327467] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.327874] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.327988] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.329137] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.329686] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.330027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.330195] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.330394] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.331423] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.331423] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.331423] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.331423] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.331423] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.331423] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.334163] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.353694] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.353966] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1212.354115] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.354292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.354604] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-493ef10d-f5a6-4986-bd43-5b23294ac00e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.354771] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.354887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.355242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.355829] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493ef10d-f5a6-4986-bd43-5b23294ac00e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.410988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.411306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.411402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.411618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.411709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.411899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.412007] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.412103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.412265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.412343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.412432] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1212.437801] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.437974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.438033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.438222] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.438558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.446462] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1212.837640] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 758ad8ee-cafe-416d-bfdf-e705035260dc: rpc.has_security_group_logging(os_id): False [ 1212.858083] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.858278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.858349] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.858649] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.858726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.858997] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.859167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.859241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.859470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.859576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.859672] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc is going to be created. [ 1212.861656] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.861934] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.862148] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.862421] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.862565] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.862714] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 493ef10d-f5a6-4986-bd43-5b23294ac00e not found, creating... [ 1212.862976] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.863201] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.863351] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.863570] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.863709] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.864008] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.864178] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.864298] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.864506] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.864642] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.864782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 493ef10d-f5a6-4986-bd43-5b23294ac00e is going to be created. [ 1212.880103] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.880315] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.880468] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.880786] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.881040] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.881286] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.920302] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.920516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.920516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.920766] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.920985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.933791] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: IN_PROGRESS for 2s [ 1213.700103] env[69847]: INFO networking_nsxv3.common.synchronization [req-19808fae-b51e-44e9-80c0-ba0912b260b2 req-3fb2ca7a-882d-455c-8f7d-7e9909b55eb0 service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1213.700315] env[69847]: INFO networking_nsxv3.common.synchronization [req-19808fae-b51e-44e9-80c0-ba0912b260b2 req-3fb2ca7a-882d-455c-8f7d-7e9909b55eb0 service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1213.700466] env[69847]: INFO networking_nsxv3.common.synchronization [req-19808fae-b51e-44e9-80c0-ba0912b260b2 req-3fb2ca7a-882d-455c-8f7d-7e9909b55eb0 service nova] Enqueued Resource ID: 493ef10d-f5a6-4986-bd43-5b23294ac00e with Priority: HIGHEST for action port [ 1213.702885] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1213.703069] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1213.703174] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493ef10d-f5a6-4986-bd43-5b23294ac00e with Priority: HIGHEST for action port [ 1213.703493] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.704150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.704260] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.704453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.704541] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.705849] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.705983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.706220] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-493ef10d-f5a6-4986-bd43-5b23294ac00e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.706330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.706391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.706582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.706662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493ef10d-f5a6-4986-bd43-5b23294ac00e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.116811] env[69847]: INFO networking_nsxv3.common.synchronization [req-15541f24-91b9-46fc-8a47-871205d70db5 req-22f91228-20b8-48e0-a1c5-8b9eeb71e06a tempest-ServersNegativeTestJSON-362728887 tempest-ServersNegativeTestJSON-362728887-project-member] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1214.117376] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1214.117687] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.117819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.117864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.118132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.118290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.118392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.118452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.118604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.118688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.118778] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.211532] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.211667] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.214736] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 493ef10d-f5a6-4986-bd43-5b23294ac00e with status ACTIVE [ 1214.214736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.214736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.214736] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.214736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.214736] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 493ef10d-f5a6-4986-bd43-5b23294ac00e is going to be updated. [ 1214.234156] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.234339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.234339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.234644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.234738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.234838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-493ef10d-f5a6-4986-bd43-5b23294ac00e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.458030] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.458030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.458030] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.458496] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.458883] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.459081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.459240] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.459564] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.459815] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.460154] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.460362] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.460569] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.460781] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.460998] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.461210] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.461368] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.462981] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1214.463169] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1214.463269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.463738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.463912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.464764] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.464764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.464764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.464764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.464764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.464764] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.480991] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.480991] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.481278] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.481521] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.481906] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-bcb9e574-649b-4903-a4fa-25386eafb1d2 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.482153] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.482294] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.482622] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.482752] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb9e574-649b-4903-a4fa-25386eafb1d2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.621628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.621816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.622029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.622206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.622329] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.622566] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.622688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.622755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.622941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.623061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.623162] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 already deleted. [ 1214.623246] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.945545] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: SUCCESS [ 1214.945713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.966384] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.985381] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.985663] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.985825] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.986254] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.986449] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.986665] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port bcb9e574-649b-4903-a4fa-25386eafb1d2 not found, creating... [ 1214.987014] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.987270] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.987493] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.987867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.988164] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.988610] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.988804] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.988929] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.989242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.989400] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.989567] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 is going to be created. [ 1215.007069] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.007316] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.007475] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.007770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.008038] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.008326] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.469158] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.971475] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.971657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.971733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.971980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.972099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.972212] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1215.997018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.997199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.997244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.997442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.997580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.006350] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1216.266294] env[69847]: INFO networking_nsxv3.common.synchronization [req-15541f24-91b9-46fc-8a47-871205d70db5 req-54685a0d-ad49-4c57-b29a-beafbf282c37 service nova] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_rules [ 1216.266294] env[69847]: INFO networking_nsxv3.common.synchronization [req-15541f24-91b9-46fc-8a47-871205d70db5 req-54685a0d-ad49-4c57-b29a-beafbf282c37 service nova] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1216.266294] env[69847]: INFO networking_nsxv3.common.synchronization [req-15541f24-91b9-46fc-8a47-871205d70db5 req-54685a0d-ad49-4c57-b29a-beafbf282c37 service nova] Enqueued Resource ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 with Priority: HIGHEST for action port [ 1216.266294] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_rules [ 1216.266294] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1216.266294] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 with Priority: HIGHEST for action port [ 1216.266757] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.266757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.266757] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.266980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.267063] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.267882] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.268030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.268075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.268801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.268801] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.268801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.268801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.268801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.268801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.268801] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.269849] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb9e574-649b-4903-a4fa-25386eafb1d2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.269975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.270029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.270178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.270254] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb9e574-649b-4903-a4fa-25386eafb1d2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.771581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.773102] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.773102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.773409] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb9e574-649b-4903-a4fa-25386eafb1d2 with status ACTIVE [ 1216.773409] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.773722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.773722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.773722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.773904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.774146] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.774146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.774146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.774289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.774382] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.774557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.774648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.774711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.774871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.774920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.775036] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 is going to be updated. [ 1216.793822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.793822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.793822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.793822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.793822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.793822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.274237] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.777475] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.777825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.777825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.777912] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.777984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.778094] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be created. [ 1217.799201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.799438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.799438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.799698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.799847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.809665] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: UNINITIALIZED for 2s [ 1218.016981] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1218.017254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.017394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.017779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.017879] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.017980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.018119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.018316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.018447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.018573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.018662] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.520910] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.521144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.521144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.521722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.521722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.521722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.521722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.522028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.522028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.522028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.522205] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.522316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.522412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.522688] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.522940] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.523170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.523225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.523478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.523620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.523754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.524020] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.027042] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20f5623-3d28-4e23-9c51-ff9f4ae3c707: rpc.has_security_group_logging(os_id): False [ 1219.044489] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.044694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.044694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.044928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.045423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.045423] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.045628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.045628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.045734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.045817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.046111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.046248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.046285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.046472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.046566] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.046778] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.046872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.046938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.047136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.047211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.047307] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1219.107730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.107880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.107950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.108179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.108326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.128220] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1219.822245] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.822245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.822245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.822245] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.324682] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.325089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.325089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.325171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.325289] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.325391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.325455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.325604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.325690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.325776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.325921] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.326075] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.326171] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.326324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.326464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.326555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.326613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.326745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.326819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.326898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.326986] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.829100] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b9de09-f768-45ef-968d-e8da5a6c24b3: rpc.has_security_group_logging(os_id): False [ 1220.846390] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.846533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.846580] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.846774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.846860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.847089] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.847183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.847237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.847386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.847462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.847644] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.847735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.847842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.847944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.848026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.848204] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.848289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.848416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.848562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.848636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.848722] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be created. [ 1220.918525] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.918682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.918721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.918899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.919094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.929351] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1221.145852] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1221.146138] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.266742] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.266857] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1222.364444] env[69847]: INFO networking_nsxv3.common.synchronization [req-aa99af44-5944-4d4a-9b4f-612c90b8ed42 req-1be8f2f0-e07a-4dc9-b403-57d2f804c395 tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1222.364948] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1222.365287] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.365410] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.365470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.365670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.365826] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.365924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.365986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.366197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.366298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.366416] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.869498] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.869498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.869786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.870042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.870042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.870290] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.870584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.870584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.870860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.870860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.871029] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1222.898461] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.898641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.898746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.898969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.899147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.907594] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1222.939776] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1222.940045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.917945] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1224.918218] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f deletion is rescheduled due to dependency. [ 1224.918314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.366388] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.366388] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1228.369441] env[69847]: INFO networking_nsxv3.common.synchronization [req-310ee864-06a7-46eb-886e-48ae4c1a8ae9 req-5119c4d2-78bc-42b0-bf69-cca604a53fae tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1228.369814] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1228.370223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.370388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.370474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.370727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.370932] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.371064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.371150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.371346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.371455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.371581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.877788] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.877986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.878081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.878305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.878404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.878605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.878717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.878756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.878903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.878975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.879074] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1228.913197] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.913345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.913405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.913620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.913948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.921891] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1229.234964] env[69847]: INFO networking_nsxv3.common.synchronization [req-16491990-fad8-41c3-8563-23c31f6a05e4 req-cd40439d-0d3a-4ae4-b8d4-704a007c6181 tempest-ServersTestBootFromVolume-1453441310 tempest-ServersTestBootFromVolume-1453441310-project-member] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_members [ 1229.235351] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGHEST for action security_group_members [ 1229.235558] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.235721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.235773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.236343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.236343] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.236343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.236343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.236540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.236589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.236653] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.742032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.742366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.742366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.743032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.743032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.743032] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.743032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.743032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.743299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.743299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.743299] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd is going to be updated. [ 1229.767897] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.768073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.768119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.768390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.768532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.776746] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd in Status: IN_PROGRESS for 2s [ 1230.932661] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1230.932661] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1230.933077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.401593] env[69847]: INFO networking_nsxv3.common.synchronization [req-8dbe2332-eace-422d-bdc3-cb0f46d52f73 req-6b03bde6-a68c-445a-81b5-94c8b04a4abf tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_members [ 1231.402280] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f0aee-549d-426e-90a7-d029d63ed8eb with Priority: HIGHEST for action security_group_members [ 1231.402280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-a84f0aee-549d-426e-90a7-d029d63ed8eb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.402280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.402280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.402552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.402552] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.402687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.402901] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.403080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.403157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.403256] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a84f0aee-549d-426e-90a7-d029d63ed8eb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.786964] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd in Status: SUCCESS [ 1231.787187] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd deletion is rescheduled due to dependency. [ 1231.787288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.905821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.906055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.906055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.906782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.906782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.906782] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.906782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.907086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.907086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.907086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.907260] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb is going to be updated. [ 1231.932492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.932622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.932694] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.932922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.933046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.941172] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f0aee-549d-426e-90a7-d029d63ed8eb in Status: IN_PROGRESS for 2s [ 1232.082673] env[69847]: INFO networking_nsxv3.common.synchronization [req-0ac129ff-5068-4b30-808c-f9853585b3b1 req-83936999-0c00-42cc-9575-e15d33d9fc4f tempest-ServersNegativeTestJSON-362728887 tempest-ServersNegativeTestJSON-362728887-project-member] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1232.083212] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1232.083576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.084215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.084215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.084215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.084774] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.084774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.084774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.084774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.084774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.084774] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.480183] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.480274] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.480418] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.480699] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.480965] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.481307] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.481450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.481692] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.481841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.482064] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.482237] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1232.482452] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1232.482614] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1232.482774] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.482893] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1232.483042] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1232.502146] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1232.502535] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1232.502535] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1232.502770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.503384] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-76ad9846-30f8-45fc-b24d-f48676ed6c96 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.503384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.503384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.503760] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.503906] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ad9846-30f8-45fc-b24d-f48676ed6c96',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.587319] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.007299] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.007745] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.007885] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.008217] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.008378] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.008571] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 76ad9846-30f8-45fc-b24d-f48676ed6c96 not found, creating... [ 1233.008867] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.009047] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.009172] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.009528] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.009661] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.009963] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.010139] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.010264] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.010539] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.010637] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.010746] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 76ad9846-30f8-45fc-b24d-f48676ed6c96 is going to be created. [ 1233.028709] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.029093] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.029175] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.029461] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.029727] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.029977] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.089681] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.592043] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.592220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.592220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.593084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.593084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.593084] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1233.619022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.619022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.619022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.619240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.619240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.627048] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1233.734604] env[69847]: INFO networking_nsxv3.common.synchronization [req-0ac129ff-5068-4b30-808c-f9853585b3b1 req-b5886522-87b9-4faa-ac5e-662795a1dbea service nova] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_rules [ 1233.734865] env[69847]: INFO networking_nsxv3.common.synchronization [req-0ac129ff-5068-4b30-808c-f9853585b3b1 req-b5886522-87b9-4faa-ac5e-662795a1dbea service nova] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1233.735114] env[69847]: INFO networking_nsxv3.common.synchronization [req-0ac129ff-5068-4b30-808c-f9853585b3b1 req-b5886522-87b9-4faa-ac5e-662795a1dbea service nova] Enqueued Resource ID: 76ad9846-30f8-45fc-b24d-f48676ed6c96 with Priority: HIGHEST for action port [ 1233.735750] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_rules [ 1233.735976] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1233.736092] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ad9846-30f8-45fc-b24d-f48676ed6c96 with Priority: HIGHEST for action port [ 1233.736462] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.736627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.736722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.736958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.737085] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.737988] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.738137] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.738375] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-76ad9846-30f8-45fc-b24d-f48676ed6c96 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.738658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.738785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.738983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.739099] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76ad9846-30f8-45fc-b24d-f48676ed6c96',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.950487] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a84f0aee-549d-426e-90a7-d029d63ed8eb in Status: SUCCESS [ 1233.950661] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a84f0aee-549d-426e-90a7-d029d63ed8eb deletion is rescheduled due to dependency. [ 1233.950778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a84f0aee-549d-426e-90a7-d029d63ed8eb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.115311] env[69847]: INFO networking_nsxv3.common.synchronization [req-5ce9836c-a7b6-4b05-b5a4-680c20fc53f8 req-cc0a7527-ae0d-4b42-b66e-020b6188fb07 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1234.115810] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1234.116223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.116365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.116425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.116633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.116825] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.116907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.116943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.117117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.117365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.117479] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.241392] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.241582] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.241700] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76ad9846-30f8-45fc-b24d-f48676ed6c96 with status ACTIVE [ 1234.241857] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.241958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.242035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.242248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.242335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.242502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.242601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.242657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.242789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.242862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.243048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.243136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.243194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.243327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.243401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.243484] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76ad9846-30f8-45fc-b24d-f48676ed6c96 is going to be updated. [ 1234.267622] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.267845] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.267891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.268581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.268581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.268581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76ad9846-30f8-45fc-b24d-f48676ed6c96" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.414015] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-635 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.414015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.414015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.414015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.414015] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.414015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.414015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.414560] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.414560] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.414560] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.414676] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.414790] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.414901] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.415081] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.415225] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.415368] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.433730] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.433906] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.434064] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.434256] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-635" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.434574] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-49bcc1ce-b775-4f1e-87ab-8d4207580716 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.435535] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.435535] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.435535] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.435638] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bcc1ce-b775-4f1e-87ab-8d4207580716',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.598616] env[69847]: INFO networking_nsxv3.common.synchronization [req-c5e0a082-81f1-4c9d-875f-cfd81293eb39 req-0946bfe2-0425-41a4-ad93-0727a1fa277a tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1234.600083] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1234.600083] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.600083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.600083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.600083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.600083] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.600083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.600335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.600335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.600389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.601022] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.622652] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.938548] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.938838] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.939172] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.939422] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.939632] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.939854] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 49bcc1ce-b775-4f1e-87ab-8d4207580716 not found, creating... [ 1234.940244] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.940440] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.940542] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.940878] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.941281] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.941408] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.941566] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.941657] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.941869] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.942018] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.942165] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 49bcc1ce-b775-4f1e-87ab-8d4207580716 is going to be created. [ 1234.961291] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.961490] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.961614] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.961887] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.962116] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.962345] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.102209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.102365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.102435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.102659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.102747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.102939] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.103050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.103114] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.103259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.103334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.103442] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1235.124965] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.133592] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.133726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.133787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.133985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.134158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.142807] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1235.627318] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.627465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.627543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.627764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.628019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.628019] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be updated. [ 1235.640051] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1235.640311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.640488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.640720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.640902] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.641026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.641094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.641243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.641325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.641417] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.654339] env[69847]: INFO networking_nsxv3.common.synchronization [req-5ce9836c-a7b6-4b05-b5a4-680c20fc53f8 req-b312334c-8616-4272-bbf6-dddd247224a9 service nova] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 1235.654339] env[69847]: INFO networking_nsxv3.common.synchronization [req-5ce9836c-a7b6-4b05-b5a4-680c20fc53f8 req-b312334c-8616-4272-bbf6-dddd247224a9 service nova] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1235.654339] env[69847]: INFO networking_nsxv3.common.synchronization [req-5ce9836c-a7b6-4b05-b5a4-680c20fc53f8 req-b312334c-8616-4272-bbf6-dddd247224a9 service nova] Enqueued Resource ID: 49bcc1ce-b775-4f1e-87ab-8d4207580716 with Priority: HIGHEST for action port [ 1235.655980] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_rules [ 1235.656126] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1235.656251] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bcc1ce-b775-4f1e-87ab-8d4207580716 with Priority: HIGHEST for action port [ 1235.657792] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.657922] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.657989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.658202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.658342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.663730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.663730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.663730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.663730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.663730] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.663730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.663730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.663730] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-49bcc1ce-b775-4f1e-87ab-8d4207580716 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.663730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.663730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.664334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.664334] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bcc1ce-b775-4f1e-87ab-8d4207580716',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.678061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: IN_PROGRESS for 2s [ 1236.143652] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.166044] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.166210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.166433] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49bcc1ce-b775-4f1e-87ab-8d4207580716 with status ACTIVE [ 1236.166588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.166692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.166752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.166965] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.167277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.167277] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.167427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.167427] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.167562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.167639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.167816] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.167903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.167962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.168108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.168213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.168264] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49bcc1ce-b775-4f1e-87ab-8d4207580716 is going to be updated. [ 1236.193869] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.194034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.194087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.194285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.194421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.194579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49bcc1ce-b775-4f1e-87ab-8d4207580716" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.397543] env[69847]: INFO networking_nsxv3.common.synchronization [req-e67f8762-606d-4b69-9bb6-44f33cf7d598 req-5b469dc4-b526-4e01-ac60-fe21e93fb83d tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1236.398067] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1236.398417] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.398588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.398679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.398899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.399090] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.399220] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.399303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.399472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.399579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.399691] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.645651] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.687748] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.688090] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.688251] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.688561] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.688773] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.688933] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.689066] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.689281] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.689430] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.689636] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.689753] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.689857] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.691166] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.691166] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.691166] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.691166] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.708258] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.708518] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.708758] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.708964] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.709305] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-478b9c36-6411-4b46-872b-edf2cc82d54a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.709503] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.709629] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.709925] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.710077] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('478b9c36-6411-4b46-872b-edf2cc82d54a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.901769] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.901933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.902015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.902240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.902336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.902535] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.902633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.902693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.902840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.902915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.903012] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1236.928051] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.928227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.928265] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.928454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.928601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.936933] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1237.148413] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.148789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.148789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.148859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.148961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.149024] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1237.152921] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 4s [ 1237.178556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.178733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.178777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.178968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.179129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.187858] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1237.215189] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.215429] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.215624] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.215965] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.216140] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.216331] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 478b9c36-6411-4b46-872b-edf2cc82d54a not found, creating... [ 1237.217015] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.217213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.217348] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.217613] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.217723] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.218021] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.218185] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.218307] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.218553] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.218802] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.218859] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 478b9c36-6411-4b46-872b-edf2cc82d54a is going to be created. [ 1237.240694] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.240928] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.241059] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.241315] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.241523] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.241808] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.686824] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 1237.687089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.687319] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.687499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.687696] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.687934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.687934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.688101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.688211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.688313] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.973445] env[69847]: INFO networking_nsxv3.common.synchronization [req-e67f8762-606d-4b69-9bb6-44f33cf7d598 req-fe3d213b-d170-4fb5-8d9e-48987bd32c02 service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 1237.973682] env[69847]: INFO networking_nsxv3.common.synchronization [req-e67f8762-606d-4b69-9bb6-44f33cf7d598 req-fe3d213b-d170-4fb5-8d9e-48987bd32c02 service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1237.973826] env[69847]: INFO networking_nsxv3.common.synchronization [req-e67f8762-606d-4b69-9bb6-44f33cf7d598 req-fe3d213b-d170-4fb5-8d9e-48987bd32c02 service nova] Enqueued Resource ID: 478b9c36-6411-4b46-872b-edf2cc82d54a with Priority: HIGHEST for action port [ 1237.974480] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 1237.974661] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1237.974755] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478b9c36-6411-4b46-872b-edf2cc82d54a with Priority: HIGHEST for action port [ 1237.975576] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.975786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.975875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.976134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.976279] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.977585] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.977691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.977876] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-478b9c36-6411-4b46-872b-edf2cc82d54a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.977980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.978052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.978229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.978308] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('478b9c36-6411-4b46-872b-edf2cc82d54a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.190967] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.481196] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.481196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.483079] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 478b9c36-6411-4b46-872b-edf2cc82d54a with status ACTIVE [ 1238.483867] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.483867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.483867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.483867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.483867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.484115] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.484178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.484242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.484399] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.484467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.484683] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.484870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.484870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.485156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.485156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.485306] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 478b9c36-6411-4b46-872b-edf2cc82d54a is going to be updated. [ 1238.507148] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.507148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.507456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.507497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.508054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.508054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.693415] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.946035] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1238.946169] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f deletion is rescheduled due to dependency. [ 1238.946306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.946470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.946693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.946871] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.946985] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.947060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.947207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.947287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.947384] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.162809] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1239.163083] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1239.163249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.195561] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.195916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.195916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.196103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.196206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.196389] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be updated. [ 1239.198729] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1239.199037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.199286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.199603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.199846] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.200015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.200185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.200453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.200608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.200760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.200901] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.230537] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.230745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.230745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.230970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.231128] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.242248] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: IN_PROGRESS for 2s [ 1239.450041] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.703634] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.703796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.703870] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.704266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.704398] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.704549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.704549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.704668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.704759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.704848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.705030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.705125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.705185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.705331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.705469] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.705558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.705616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.705748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.705824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.705920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.706021] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.952965] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.208930] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b9de09-f768-45ef-968d-e8da5a6c24b3: rpc.has_security_group_logging(os_id): False [ 1240.228611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.228876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.228876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.229550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.229550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.229550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.229550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.229550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.229828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.229828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.229943] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.230057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.230121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.230272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.230373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.230523] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.230616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.230695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.230818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.230893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.230997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1240.301440] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.301440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.301440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.301686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.301795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.313346] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1240.456127] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.456936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.456936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.456936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.456936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.456936] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1240.492434] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.492562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.492639] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.492848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.492988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.503972] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1241.252257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 1241.252519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.252633] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.252833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.253022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.253143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.253209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.253357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.253435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.253515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.253605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.476442] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f6a34e-2434-4193-a150-d711b31b2a5b req-002c4d29-af99-4bb2-8206-246cbbf19c82 tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1241.476509] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1241.476822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.476959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.477019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.477884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.478102] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.478263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.478391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.478588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.478714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.478841] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.757528] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.828659] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.829253] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.829253] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.829422] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.829572] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.829722] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.829840] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.831219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.831353] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.831588] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1241.831709] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.831823] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.831935] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.832057] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1241.832273] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.832331] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.851122] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.852172] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1241.852394] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.852594] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.852984] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-586589e3-3c5c-4f60-83d3-299d56309cef taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.853184] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.853315] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.853649] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.853790] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('586589e3-3c5c-4f60-83d3-299d56309cef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.981426] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.981630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.981630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.981925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.982037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.982245] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.982374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.982423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.982558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.982646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.982828] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1242.006129] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.006315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.006398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.006629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.006835] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.014375] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1242.260928] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e: rpc.has_security_group_logging(os_id): False [ 1242.278858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.279716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.279716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.279716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.301058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.301433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.301607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.301699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.301944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.302045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.302204] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be updated. [ 1242.325313] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1242.325537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.360854] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.361226] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.361381] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.361668] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.361823] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.362015] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 586589e3-3c5c-4f60-83d3-299d56309cef not found, creating... [ 1242.362350] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.362523] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.362671] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.362968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.363171] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.363471] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.363633] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.363752] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.363964] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.364117] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.364261] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 586589e3-3c5c-4f60-83d3-299d56309cef is going to be created. [ 1242.366178] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.366371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.366443] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.366602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.366737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.384394] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: IN_PROGRESS for 2s [ 1242.390770] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.390770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.390952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.391293] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.391589] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.391907] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.513805] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1242.513805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.513805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.513805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.514118] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.514264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.514368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.514537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.514618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.514704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.514793] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.016494] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.084749] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f6a34e-2434-4193-a150-d711b31b2a5b req-2c23ee88-3054-49b4-8043-c748b4317d41 service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1243.084816] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f6a34e-2434-4193-a150-d711b31b2a5b req-2c23ee88-3054-49b4-8043-c748b4317d41 service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1243.088123] env[69847]: INFO networking_nsxv3.common.synchronization [req-c2f6a34e-2434-4193-a150-d711b31b2a5b req-2c23ee88-3054-49b4-8043-c748b4317d41 service nova] Enqueued Resource ID: 586589e3-3c5c-4f60-83d3-299d56309cef with Priority: HIGHEST for action port [ 1243.088123] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1243.088123] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1243.088123] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 586589e3-3c5c-4f60-83d3-299d56309cef with Priority: HIGHEST for action port [ 1243.088123] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.088123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.088123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.088123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.088123] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.089164] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.089306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.089548] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-586589e3-3c5c-4f60-83d3-299d56309cef taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.089700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.089799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.090054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.090166] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('586589e3-3c5c-4f60-83d3-299d56309cef',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.519035] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7c8712-c7ea-4340-b068-333e83abf23f: rpc.has_security_group_logging(os_id): False [ 1243.535541] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.535956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.535956] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.536097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.536167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.536451] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.536575] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.536657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.536850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.536946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.537061] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1243.590355] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.590529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.590612] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.590829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.591019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.592314] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.592414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.594040] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 586589e3-3c5c-4f60-83d3-299d56309cef with status ACTIVE [ 1243.594215] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.594335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.594511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.594666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.594666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.594831] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.594937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.594998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.595158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.595238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.595433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.595535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.595696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.595816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.595816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.595894] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 586589e3-3c5c-4f60-83d3-299d56309cef is going to be updated. [ 1243.607724] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1243.617721] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.617856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.618601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.618601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.618601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.618601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-586589e3-3c5c-4f60-83d3-299d56309cef" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.025362] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1244.025362] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1244.025362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.025362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.025681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.026876] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.026876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.026876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.026876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.026876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.026876] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.402077] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 1244.402077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.530026] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.031621] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.157647] env[69847]: INFO networking_nsxv3.common.synchronization [req-4e720b04-dada-4462-acaf-22eccddaa8d8 req-b25bd8f4-3f16-4060-a13f-1b3a1fdb0f35 tempest-ServersNegativeTestJSON-362728887 tempest-ServersNegativeTestJSON-362728887-project-member] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1245.158431] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1245.158684] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.158855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.158890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.159243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.159409] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.159508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.159568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.159723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.159805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.159896] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.534018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.534369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.534369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.534569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.534662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.534765] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1245.561137] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.561287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.561359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.561601] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.561774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.569623] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1245.618877] env[69847]: INFO networking_nsxv3.common.synchronization [req-12df5faf-7acd-4cdc-bc70-c548aa5fe175 req-83e2f91c-d5d3-4585-902e-d7ae70b0b7a3 tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1245.619781] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1245.619983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.620863] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1245.621179] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.621298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.621363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.621569] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.621729] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.621808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.621867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.622051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.622170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.622278] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.661895] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.126798] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.126958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.127039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.127258] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.127356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.127557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.127659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.127720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.127878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.127960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.128058] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1246.159023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.159023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.159023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.159023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.159023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.165804] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1246.165804] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.425448] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.425679] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.425800] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.426079] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.426948] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.427160] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.427438] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.427689] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.427850] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.428070] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.428187] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.428297] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.428405] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.428516] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1246.428702] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.428860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.446559] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.447864] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1246.447864] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.447864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.447864] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.447864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.447864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.448224] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.448224] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb8f846c-02a0-431b-99bb-3f9ee51bb36d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.668904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.669269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.669269] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.669356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.669434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.669534] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1246.694095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.694261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.694320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.694487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.694632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.703401] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1246.950741] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.950955] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.951110] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.951425] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.951590] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.951756] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port fb8f846c-02a0-431b-99bb-3f9ee51bb36d not found, creating... [ 1246.952061] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.952235] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.952362] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.952609] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.952758] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.953053] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.953217] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.953337] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.953557] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.953710] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.953851] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: fb8f846c-02a0-431b-99bb-3f9ee51bb36d is going to be created. [ 1246.974987] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.975213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.975345] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.975611] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.975841] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.976090] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.578202] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1247.578413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.578589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.578862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.579048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.579164] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.579282] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.579372] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.582039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.582039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.582039] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.764962] env[69847]: INFO networking_nsxv3.common.synchronization [req-12df5faf-7acd-4cdc-bc70-c548aa5fe175 req-2b466fa3-1fba-4492-ad96-bad7ae5681ea service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1247.764962] env[69847]: INFO networking_nsxv3.common.synchronization [req-12df5faf-7acd-4cdc-bc70-c548aa5fe175 req-2b466fa3-1fba-4492-ad96-bad7ae5681ea service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1247.766375] env[69847]: INFO networking_nsxv3.common.synchronization [req-12df5faf-7acd-4cdc-bc70-c548aa5fe175 req-2b466fa3-1fba-4492-ad96-bad7ae5681ea service nova] Enqueued Resource ID: fb8f846c-02a0-431b-99bb-3f9ee51bb36d with Priority: HIGHEST for action port [ 1247.767297] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1247.767389] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1247.767495] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb8f846c-02a0-431b-99bb-3f9ee51bb36d with Priority: HIGHEST for action port [ 1247.768355] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.768355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.768355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.768598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.768598] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.770159] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.770257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.770455] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.770558] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.770622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.771613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.771613] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb8f846c-02a0-431b-99bb-3f9ee51bb36d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.082458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.082716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.082716] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.082967] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.083172] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.083288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.083363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.083504] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.083589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.083675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.083820] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.083911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.083970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.084147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.084295] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.084385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.084438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.084578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.084653] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.084733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.084822] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.174307] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1248.174519] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1248.174636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.174785] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.174999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.175190] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.175304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.175368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.175521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.175599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.175691] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.270649] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.270846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.273209] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb8f846c-02a0-431b-99bb-3f9ee51bb36d with status ACTIVE [ 1248.273406] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.273531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.273591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.273836] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.273893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.274076] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.274175] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.274405] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.274620] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.274711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.274937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.275067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.275133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.275289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.275367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.275461] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb8f846c-02a0-431b-99bb-3f9ee51bb36d is going to be updated. [ 1248.295969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.296172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.296221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.296816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.296816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.296816] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb8f846c-02a0-431b-99bb-3f9ee51bb36d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.588026] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa82bf-be1b-4e2a-9d96-94b63738ba8c: rpc.has_security_group_logging(os_id): False [ 1248.604702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.604702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.604702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.604702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.605139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.605139] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.605139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.605385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.605385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.605385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.606854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.606854] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.606854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.606854] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1248.660858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.661012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.661084] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.661294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.661437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.672097] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1248.677457] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.714391] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1248.714587] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.179675] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.681751] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.681911] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.681955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.682191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.682296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.682400] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1249.707023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.707119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.707161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.707398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.707538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.715178] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1250.684340] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1250.684731] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.725758] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1251.726152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.726278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.726513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.726784] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.726944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.727048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.727253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.727361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.727477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.727600] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.229917] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.230149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.230251] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.230552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.230777] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.230914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.231017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.231244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.231367] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.231492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.231703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.231825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.231913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.232121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.232315] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.232447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.232537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.232725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.232832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.232946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.233083] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.735213] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20f5623-3d28-4e23-9c51-ff9f4ae3c707: rpc.has_security_group_logging(os_id): False [ 1252.752745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.752882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.752937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.753142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.753233] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.753433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.753538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.753596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.753750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.753823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.754013] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.754110] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.754169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.754306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.754484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.754871] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.754988] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.755068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.755230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.755312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.755400] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1252.768727] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.768844] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1252.808433] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.808626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.808692] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.808865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.809020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.818587] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1254.832648] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1254.833009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.466498] env[69847]: INFO networking_nsxv3.common.synchronization [req-9f114999-f4a2-42bd-9cc7-b608862fbeb4 req-fee3ad6c-16dd-43bf-9dc3-1b064ca04643 tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1256.466804] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1256.467115] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.467240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.467308] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.467550] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.467676] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.467772] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.467833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.467974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.468068] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.468177] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.971034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.971034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.971034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.971386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.971386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.971581] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.971700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.971737] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.971873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.971932] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.972031] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1257.003613] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.003803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.003803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.004022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.004203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.014533] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1259.030468] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1259.030765] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1259.030841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.467762] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.468083] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.319546] env[69847]: INFO networking_nsxv3.common.synchronization [req-79e3cd9b-252c-4c79-9c3b-b423f2246c57 req-f4bdf603-104f-4477-a472-afba5ff4585c tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1266.320492] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1266.321326] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.321326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.321326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.321326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.321607] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.321607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.321607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.322041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.322041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.322041] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.678839] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.679070] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.679206] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.679491] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.679790] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.679935] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.680228] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.680468] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.680658] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.680872] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.681084] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.681224] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.681337] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.681453] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1266.681561] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.681719] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.701355] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.701548] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1266.701654] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.701852] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.702197] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.702401] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.702522] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.702878] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.703026] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8b840c2-5b00-4f4b-a73a-3eefe20912fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.824696] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.824963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.825016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.825248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.825344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.825573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.825678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.825739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.825897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.825979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.826090] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1266.851241] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.851481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.851481] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.851741] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.851926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.859950] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1267.205386] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.205626] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.205755] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.206064] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.206248] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.206487] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port b8b840c2-5b00-4f4b-a73a-3eefe20912fe not found, creating... [ 1267.206724] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.206857] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.206979] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.207242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.207387] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.207679] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.207853] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.207986] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.208212] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.208351] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.208812] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: b8b840c2-5b00-4f4b-a73a-3eefe20912fe is going to be created. [ 1267.228316] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.228561] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.228623] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.228897] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.229174] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.229410] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.912531] env[69847]: INFO networking_nsxv3.common.synchronization [req-79e3cd9b-252c-4c79-9c3b-b423f2246c57 req-8985bdb8-f6d8-4850-b12e-95ed901fd642 service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1267.912786] env[69847]: INFO networking_nsxv3.common.synchronization [req-79e3cd9b-252c-4c79-9c3b-b423f2246c57 req-8985bdb8-f6d8-4850-b12e-95ed901fd642 service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1267.912864] env[69847]: INFO networking_nsxv3.common.synchronization [req-79e3cd9b-252c-4c79-9c3b-b423f2246c57 req-8985bdb8-f6d8-4850-b12e-95ed901fd642 service nova] Enqueued Resource ID: b8b840c2-5b00-4f4b-a73a-3eefe20912fe with Priority: HIGHEST for action port [ 1267.913120] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1267.913246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1267.913338] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b840c2-5b00-4f4b-a73a-3eefe20912fe with Priority: HIGHEST for action port [ 1267.913903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.914054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.914121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.914314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.914387] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.915223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.915310] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.915505] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.915599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.915661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.915825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.915898] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8b840c2-5b00-4f4b-a73a-3eefe20912fe',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.418188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.418527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.418527] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8b840c2-5b00-4f4b-a73a-3eefe20912fe with status ACTIVE [ 1268.418716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.418850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.419019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.419288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.419385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.419560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.419658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.419718] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.419889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.419966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.420167] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.420261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.420322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.420460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.420534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.420618] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8b840c2-5b00-4f4b-a73a-3eefe20912fe is going to be updated. [ 1268.439829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.440019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.440019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.440207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.440332] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.440485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8b840c2-5b00-4f4b-a73a-3eefe20912fe" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.870819] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1268.871140] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1268.871411] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.871665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.872641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.872855] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.873086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.873244] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.873573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.875085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.875247] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.381457] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.883971] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.387662] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.388202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.388202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.388293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.388325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.388418] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1270.425754] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.425754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.425953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.426149] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.426240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.434187] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1272.444676] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1272.445067] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.445147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.445324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.445514] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.445630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.445695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.445907] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.446011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.446104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.446191] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.914061] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.914196] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1272.948050] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.948294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.948294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.948497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.948662] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.948761] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.948993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.948993] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.949098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.949142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.949394] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.949394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.949511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.949571] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.949703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.949792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.949851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.949983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.950074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.950150] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.950237] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.453697] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa82bf-be1b-4e2a-9d96-94b63738ba8c: rpc.has_security_group_logging(os_id): False [ 1273.472086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.472270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.472594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.472594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.472722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.472898] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.473011] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.473078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.473285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.473371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.473548] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.473637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.474026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.474193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.474272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.474458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.474687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.474753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.474902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.474977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.475176] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1273.537638] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.537869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.537940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.538397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.538397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.550542] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1275.566053] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1275.566353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.915116] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.915491] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.439337] env[69847]: INFO networking_nsxv3.common.synchronization [req-bf89bada-3554-4c70-af1e-433a9db7ef11 req-6df6c68f-69c0-48bc-b7bd-8fe145284529 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1280.439892] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1280.440659] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.440659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.440659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.440659] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.440981] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.440981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.440981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.441203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.441203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.441273] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.944759] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.944759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.944759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.945080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.968589] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.968848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.968976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.969071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.969238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.969321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.969416] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1280.993152] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.993346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.993346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.994899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.994899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.001823] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1282.581369] env[69847]: INFO networking_nsxv3.common.synchronization [req-2472851f-8fef-4c0c-a74b-a46b761c06ce req-83bfd95b-d066-4ab7-851f-2623c8756d7f tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1282.581369] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1282.581369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.581704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.581704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.581704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.581804] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.581880] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.581918] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.582086] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.582157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.582247] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.013191] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1283.013365] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad deletion is rescheduled due to dependency. [ 1283.013477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.085185] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.085391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.085391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.085608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.085699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.085926] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.086019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.086057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.086216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.086292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.086378] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1283.113017] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.113154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.113240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.113484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.113647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.121419] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1285.132053] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1285.132343] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1285.132343] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.234071] env[69847]: INFO networking_nsxv3.common.synchronization [None req-6de35df9-e169-4c4e-b583-66f5f0511d0b tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: 3ff18c43-132b-4ba1-b9f0-b5b03a545c68 with Priority: HIGHEST for action security_group_rules [ 1286.234596] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff18c43-132b-4ba1-b9f0-b5b03a545c68 with Priority: HIGHEST for action security_group_rules [ 1286.234905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.235072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.235132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.235351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.235432] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ff18c43-132b-4ba1-b9f0-b5b03a545c68',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.310510] env[69847]: INFO networking_nsxv3.common.synchronization [None req-008bc447-5fd3-4109-be41-4018511d346f tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: 3ff18c43-132b-4ba1-b9f0-b5b03a545c68 with Priority: HIGHEST for action security_group_rules [ 1286.311088] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff18c43-132b-4ba1-b9f0-b5b03a545c68 with Priority: HIGHEST for action security_group_rules [ 1286.311432] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.311553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.754085] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.754276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.754813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.754813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.754813] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.755103] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ff18c43-132b-4ba1-b9f0-b5b03a545c68 already deleted. [ 1286.755103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.755295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.755454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.755539] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ff18c43-132b-4ba1-b9f0-b5b03a545c68',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.277125] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.277387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.277387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.277650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.277801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.277941] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ff18c43-132b-4ba1-b9f0-b5b03a545c68 already deleted. [ 1287.278069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ff18c43-132b-4ba1-b9f0-b5b03a545c68" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.543673] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.544031] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.544093] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.544380] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.544707] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.544924] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.545075] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.545330] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.545512] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.545749] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1288.545881] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1288.546000] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1288.546220] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1288.546292] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1288.546421] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1288.546564] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1288.565052] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1288.565226] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1288.565376] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1288.565566] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-121" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.565884] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.566090] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.566220] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.566473] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.566612] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c280f7c-89df-44e1-b477-13a6e8bbdd5f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.069370] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.069614] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.069775] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.070098] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.070293] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.070623] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.070794] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.070943] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.071214] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.071509] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.071850] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.072059] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.072200] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.072462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.073066] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.073066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f is going to be updated. [ 1289.092515] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.092799] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.092865] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.093145] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.093292] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.093519] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.140370] env[69847]: INFO networking_nsxv3.common.synchronization [req-389613ff-aa49-4229-9ab5-69acafd61fe4 req-afe3247c-846d-4d3b-9b03-b8e9d40e87ef tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1289.140727] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1289.142239] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.142239] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.142239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.142239] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.647022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.647022] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.647022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.647022] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1289.674793] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.674793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.674793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.674793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.674793] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.681588] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1289.754266] env[69847]: INFO networking_nsxv3.common.synchronization [req-6747d2bb-54d2-4159-aec1-766403d5d353 req-c19eedb0-657d-4a96-adda-d4587a210aee service nova] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1289.754266] env[69847]: INFO networking_nsxv3.common.synchronization [req-6747d2bb-54d2-4159-aec1-766403d5d353 req-c19eedb0-657d-4a96-adda-d4587a210aee service nova] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1289.754266] env[69847]: INFO networking_nsxv3.common.synchronization [req-6747d2bb-54d2-4159-aec1-766403d5d353 req-c19eedb0-657d-4a96-adda-d4587a210aee service nova] Enqueued Resource ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f with Priority: HIGHEST for action port [ 1289.754266] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_rules [ 1289.754266] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1289.754266] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f with Priority: HIGHEST for action port [ 1289.754266] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.754266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.754266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.754266] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.754266] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.755745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.755745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.755745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.755745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.755745] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.756201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.756201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.756201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.756201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.756201] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.758414] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.758517] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.758583] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.758725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.758795] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c280f7c-89df-44e1-b477-13a6e8bbdd5f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.260528] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.262237] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.262390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.262497] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c280f7c-89df-44e1-b477-13a6e8bbdd5f with status ACTIVE [ 1290.262655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.262789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.262849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.263022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.263136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.263281] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.263378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.263477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.263621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.263705] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.263877] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.263964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.264025] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.264168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.264239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.264324] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c280f7c-89df-44e1-b477-13a6e8bbdd5f is going to be updated. [ 1290.283783] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.283972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.283972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.284271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.284362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.284470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c280f7c-89df-44e1-b477-13a6e8bbdd5f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.766191] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.269519] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.269746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.269746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.269921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.270021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.270199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc is going to be updated. [ 1291.303930] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.304200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.304200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.304370] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.304502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.316048] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: IN_PROGRESS for 2s [ 1291.694521] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1291.694660] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1291.694778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.326098] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: SUCCESS [ 1293.326507] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.326647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.326969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.327268] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.327466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.327568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.327804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.327933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.328082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.328222] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.830708] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.333255] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 758ad8ee-cafe-416d-bfdf-e705035260dc: rpc.has_security_group_logging(os_id): False [ 1294.350382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.350615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.350615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.350801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.350891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.351223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.351331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.351397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.351554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.351632] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.351722] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc is going to be updated. [ 1294.413879] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.414146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.414213] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.414487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.414941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.427306] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: IN_PROGRESS for 2s [ 1294.753413] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.753651] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1295.333968] env[69847]: INFO networking_nsxv3.common.synchronization [req-ccc08f1b-1181-4238-adfc-d335a5d295ea req-fc00640c-aa85-47ab-b52d-f163dd86275a tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1295.334566] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1295.334873] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.335122] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.335226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.335459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.335588] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.335717] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.335779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.335933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.336030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.336119] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.618770] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.618971] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.619111] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.619409] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.619674] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.619835] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.620038] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.620289] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.620439] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.620674] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.620792] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1295.620899] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1295.621027] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1295.621143] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.621269] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1295.621489] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1295.639062] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1295.639345] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1295.639552] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1295.639968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.640415] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-4693c7f2-f6b5-4c13-b685-7af929b3ff79 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.640647] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.640822] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.641256] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.641422] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4693c7f2-f6b5-4c13-b685-7af929b3ff79',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.838196] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.838359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.838420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.838664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.838743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.838943] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.839061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.839125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.839288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.839361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.839450] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1295.864821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.865049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.865049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.865273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.865485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.874233] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1296.144839] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.144839] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.144839] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.145181] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.145677] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.145677] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 4693c7f2-f6b5-4c13-b685-7af929b3ff79 not found, creating... [ 1296.145677] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.145867] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.146027] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.146337] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.146520] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.146851] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.147983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.147983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.147983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.147983] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.147983] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 4693c7f2-f6b5-4c13-b685-7af929b3ff79 is going to be created. [ 1296.168024] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.168325] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.168490] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.168972] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.169091] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.169401] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.442066] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: SUCCESS [ 1296.442493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.869242] env[69847]: INFO networking_nsxv3.common.synchronization [req-ccc08f1b-1181-4238-adfc-d335a5d295ea req-0887d819-3f78-4bb5-9c49-06d4b05fefd2 service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1296.869433] env[69847]: INFO networking_nsxv3.common.synchronization [req-ccc08f1b-1181-4238-adfc-d335a5d295ea req-0887d819-3f78-4bb5-9c49-06d4b05fefd2 service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1296.869575] env[69847]: INFO networking_nsxv3.common.synchronization [req-ccc08f1b-1181-4238-adfc-d335a5d295ea req-0887d819-3f78-4bb5-9c49-06d4b05fefd2 service nova] Enqueued Resource ID: 4693c7f2-f6b5-4c13-b685-7af929b3ff79 with Priority: HIGHEST for action port [ 1296.869822] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1296.869954] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1296.870065] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4693c7f2-f6b5-4c13-b685-7af929b3ff79 with Priority: HIGHEST for action port [ 1296.870719] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.870775] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.870814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.871525] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.871721] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.872733] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.873033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.873287] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4693c7f2-f6b5-4c13-b685-7af929b3ff79 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.873465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.873584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.873788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.873961] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4693c7f2-f6b5-4c13-b685-7af929b3ff79',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.380060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.380060] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4693c7f2-f6b5-4c13-b685-7af929b3ff79 with status ACTIVE [ 1297.380060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.380060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.380060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.380060] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.380614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.380614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.380614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.380614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.380614] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4693c7f2-f6b5-4c13-b685-7af929b3ff79 is going to be updated. [ 1297.409906] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.410124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.410124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.410337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.410473] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.410630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4693c7f2-f6b5-4c13-b685-7af929b3ff79" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.548807] env[69847]: INFO networking_nsxv3.common.synchronization [req-7412de4a-330c-4984-833c-7fdf1b5bc289 req-57152327-1a7a-4119-b7d2-031e2937c531 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1297.549388] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1297.549708] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.549831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.549899] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.550106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.550332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.550434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.550496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.550650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.550733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.550822] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.830412] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.830657] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.830768] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.831242] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.831414] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.831520] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.831626] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.831857] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.832034] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.832248] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1297.832379] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1297.832504] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1297.832630] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1297.832748] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1297.832856] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1297.832990] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1297.852514] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1297.852701] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1297.852848] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1297.853042] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.853384] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-636c623e-aec6-430a-a019-d13c8e1fed13 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.853565] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.853688] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.854081] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.854340] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('636c623e-aec6-430a-a019-d13c8e1fed13',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.883845] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1297.884036] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1297.884186] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.884338] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.884548] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.884722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.884851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.884917] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.885089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.885169] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.885265] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.053482] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.053681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.053681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.053893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.054062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.054273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.054415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.054499] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.054665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.054743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.054850] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1298.078914] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.079107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.079156] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.079500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.079658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.088291] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1298.356540] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.356796] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.356965] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.357300] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.357476] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.357637] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 636c623e-aec6-430a-a019-d13c8e1fed13 not found, creating... [ 1298.357963] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.358198] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.358359] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.358604] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.358769] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.359071] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.359238] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.359366] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.359591] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.359731] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.359873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 636c623e-aec6-430a-a019-d13c8e1fed13 is going to be created. [ 1298.378247] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.378481] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.378597] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.378912] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.379240] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.379456] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.387012] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.889436] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.106956] env[69847]: INFO networking_nsxv3.common.synchronization [req-7412de4a-330c-4984-833c-7fdf1b5bc289 req-79fd29a3-6843-4f60-9e70-a31a2c0b88fd service nova] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 1299.107181] env[69847]: INFO networking_nsxv3.common.synchronization [req-7412de4a-330c-4984-833c-7fdf1b5bc289 req-79fd29a3-6843-4f60-9e70-a31a2c0b88fd service nova] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1299.107334] env[69847]: INFO networking_nsxv3.common.synchronization [req-7412de4a-330c-4984-833c-7fdf1b5bc289 req-79fd29a3-6843-4f60-9e70-a31a2c0b88fd service nova] Enqueued Resource ID: 636c623e-aec6-430a-a019-d13c8e1fed13 with Priority: HIGHEST for action port [ 1299.107575] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 1299.107725] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1299.107787] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 636c623e-aec6-430a-a019-d13c8e1fed13 with Priority: HIGHEST for action port [ 1299.108385] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.108511] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.108578] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.108782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.108863] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.115392] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.115392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.115392] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-636c623e-aec6-430a-a019-d13c8e1fed13 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.115392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.115392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.115392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.115392] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('636c623e-aec6-430a-a019-d13c8e1fed13',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.392199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.392376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.392442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.392646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.392735] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.392860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1299.429997] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.430228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.430228] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.430452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.430593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.438920] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1299.616505] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.616678] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.617016] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 636c623e-aec6-430a-a019-d13c8e1fed13 with status ACTIVE [ 1299.617224] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.617414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.617414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.617592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.617669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.617840] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.617937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.618019] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.618679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.618679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.618679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.618679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.618679] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.619014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.619014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.619014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 636c623e-aec6-430a-a019-d13c8e1fed13 is going to be updated. [ 1299.639336] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.639531] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.639574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.639797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.639939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.640184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-636c623e-aec6-430a-a019-d13c8e1fed13" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.784239] env[69847]: INFO networking_nsxv3.common.synchronization [req-60ba4e04-6034-45f4-9adc-acc49756f677 req-76aa3289-25e0-473b-84f6-b581e5ff6df1 tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1299.784664] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1299.785059] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.785263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.785263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.785470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.785614] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.785713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.785802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.785960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.786063] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.786208] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.097353] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1300.097788] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad deletion is rescheduled due to dependency. [ 1300.097788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.097788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.097976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.098192] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.098324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.098388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.098522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.098600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.098708] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.108265] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.108464] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.108593] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.108850] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.109126] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.109288] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.109406] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.109618] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.109767] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.109985] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.110103] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1300.110213] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1300.110322] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1300.110451] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.110561] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1300.110695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1300.126612] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1300.126817] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1300.126957] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1300.127238] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-117" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.127469] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.127636] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.127755] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.128098] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.128253] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eac8e33-3a87-4eeb-a653-b9e299b6a5e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.289301] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.289476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.289549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.289794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.289941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.290238] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.290369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.290452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.290666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.290771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.290863] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1300.315651] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.315843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.315904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.316102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.316249] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.325278] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1300.600782] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.630890] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.631134] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.631267] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.631598] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.631805] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.631991] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 not found, creating... [ 1300.632275] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.632438] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.632596] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.632873] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.633062] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.633384] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.633553] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.633734] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.633990] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.634152] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.634302] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 is going to be created. [ 1300.657074] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.657355] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.657507] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.657834] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.658144] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.658403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.103013] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.351257] env[69847]: INFO networking_nsxv3.common.synchronization [req-60ba4e04-6034-45f4-9adc-acc49756f677 req-89db5c59-ca16-4ca8-afa7-006bb9b70b6c service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1301.351444] env[69847]: INFO networking_nsxv3.common.synchronization [req-60ba4e04-6034-45f4-9adc-acc49756f677 req-89db5c59-ca16-4ca8-afa7-006bb9b70b6c service nova] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1301.351585] env[69847]: INFO networking_nsxv3.common.synchronization [req-60ba4e04-6034-45f4-9adc-acc49756f677 req-89db5c59-ca16-4ca8-afa7-006bb9b70b6c service nova] Enqueued Resource ID: 1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 with Priority: HIGHEST for action port [ 1301.351818] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_rules [ 1301.351946] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1301.352054] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 with Priority: HIGHEST for action port [ 1301.352593] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.352719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.352795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.352976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.353453] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.355711] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.355711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.355711] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.355711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.355711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.355711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.355711] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1eac8e33-3a87-4eeb-a653-b9e299b6a5e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.448346] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1301.448521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.448572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.448743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.448936] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.449066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.449129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.449280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.449355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.449438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.449524] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.605817] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.606014] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.606064] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.606237] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.606327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.606429] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1301.641134] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.641304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.641376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.641555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.641700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.651224] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1301.857491] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.857729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.857865] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 with status ACTIVE [ 1301.858070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.858236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.858236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.858449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.858541] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.858721] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.858819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.858936] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.859079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.859142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.859273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.859359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.859430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.859555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.859637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.859734] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1eac8e33-3a87-4eeb-a653-b9e299b6a5e3 is going to be updated. [ 1301.880463] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.880695] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.880782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.881090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.881299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.881539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1eac8e33-3a87-4eeb-a653-b9e299b6a5e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.951470] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.951713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.951776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.952032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.952224] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.952373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.952456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.952691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.952801] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.952914] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.953165] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.953291] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.953388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.953615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.953845] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.953997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.954102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.954306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.954419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.954528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.954703] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.334645] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1302.335026] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1302.335026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.335109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.335331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.335506] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.335621] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.335684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.335834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.335915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.336015] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.449043] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.449336] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.449521] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.449822] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.450113] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.450278] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.450399] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.450622] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.450770] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.450987] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.451115] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.451228] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.451338] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.451448] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.451554] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.451697] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.456712] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20f5623-3d28-4e23-9c51-ff9f4ae3c707: rpc.has_security_group_logging(os_id): False [ 1302.475274] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.475438] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1302.475574] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.475750] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-660" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.476068] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-bcb9e574-649b-4903-a4fa-25386eafb1d2 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.476246] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.476360] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.476606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.476743] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb9e574-649b-4903-a4fa-25386eafb1d2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.479897] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.480040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.480108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.480283] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.480429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.480572] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.480671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.480729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.480872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.480945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.481141] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.481235] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.481292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.481425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.481509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.481668] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.481759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.481817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.481948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.482034] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.482119] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1302.554753] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.555135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.555135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.555280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.555325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.568776] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1302.838556] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.980309] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.980309] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.980437] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.980688] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.980842] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.981173] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.981341] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.981462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.981683] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.981820] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.982119] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.982277] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.982396] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.982601] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.982738] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.982883] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 is going to be updated. [ 1303.003319] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.003574] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.003782] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.004167] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.004456] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.004782] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.340910] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.660921] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1303.661098] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.661538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.661538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.661784] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.661784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.662031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.662031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.662031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.662195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.662195] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.807492] env[69847]: INFO networking_nsxv3.common.synchronization [req-2517647b-9cb7-42d1-a528-3bbdec21bad2 req-b37d01b5-779f-4579-b2d6-20468ef500ca service nova] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_rules [ 1303.807749] env[69847]: INFO networking_nsxv3.common.synchronization [req-2517647b-9cb7-42d1-a528-3bbdec21bad2 req-b37d01b5-779f-4579-b2d6-20468ef500ca service nova] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1303.807943] env[69847]: INFO networking_nsxv3.common.synchronization [req-2517647b-9cb7-42d1-a528-3bbdec21bad2 req-b37d01b5-779f-4579-b2d6-20468ef500ca service nova] Enqueued Resource ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 with Priority: HIGHEST for action port [ 1303.808521] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_rules [ 1303.808680] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1303.808796] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 with Priority: HIGHEST for action port [ 1303.809265] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.809465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.809627] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.809909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.810074] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.811029] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.811225] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.811355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.811604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.811863] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.812106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.812208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.812434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.812608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.812707] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.814047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb9e574-649b-4903-a4fa-25386eafb1d2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.814195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.814288] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.814501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.814651] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb9e574-649b-4903-a4fa-25386eafb1d2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.843624] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.843838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.843958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.844231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.844353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.844486] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1303.871635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.871863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.871863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.872080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.872215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.880127] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1304.164166] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.316742] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.316867] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.317105] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.317937] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb9e574-649b-4903-a4fa-25386eafb1d2 with status ACTIVE [ 1304.318680] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.318680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.318680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.318680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.318680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.319021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.319021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.319021] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.319136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.319168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.319392] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.319494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.319551] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.320083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.320083] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.320083] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb9e574-649b-4903-a4fa-25386eafb1d2 is going to be updated. [ 1304.339734] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.339854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.339919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.340130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.340264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.340526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb9e574-649b-4903-a4fa-25386eafb1d2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.581115] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1304.581485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.666262] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8982c0b6-8a83-4e29-82e9-02c4a6ebebad: rpc.has_security_group_logging(os_id): False [ 1304.688152] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.688306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.688353] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.688556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.688647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.688916] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.689018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.689060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.689207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.689286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.689371] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1304.748817] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.748817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.748817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.748817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.748817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.762602] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1304.822313] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.324724] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.324955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.325115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.325444] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.325585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.325752] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1305.354199] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.354318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.354437] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.354751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.354981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.363425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1305.888694] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1305.888924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.889087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.889350] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.889550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.889672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.889729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.889872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.890108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.890108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.890108] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.392962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.393185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.393241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.393425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.393603] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.393732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.393799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.393983] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.394090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.394197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.394352] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.394460] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.394521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.394680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.394821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.394919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.395033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.395168] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.395250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.395342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.395430] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.777809] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1306.778118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.900946] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa82bf-be1b-4e2a-9d96-94b63738ba8c: rpc.has_security_group_logging(os_id): False [ 1306.918181] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.918409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.918409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.918640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.918748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.918969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.920026] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.920026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.920413] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.920413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.920501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.920606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.920690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.920782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1306.976028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.976279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.976279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.976516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.976672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.988738] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1307.372494] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1307.372734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.372890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.373144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.373339] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.373469] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.373539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.373850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.373850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.373850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.374101] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.880066] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.880271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.880320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.880672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.880895] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.881029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.881089] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.882049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.882049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.882049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.882049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.882049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.882049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.882049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.882049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.882604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.882604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.882604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.882604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.882604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.882604] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.385104] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22b9de09-f768-45ef-968d-e8da5a6c24b3: rpc.has_security_group_logging(os_id): False [ 1308.403140] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.403351] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.403465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.403760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.403906] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.404213] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.404355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.404440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.404687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.404805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.405397] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.405397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.405577] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.405780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.405852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.406111] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.406257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.406344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.406549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.406686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.406823] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1308.465701] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.465915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.466087] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.466327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.466526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.479320] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1308.809612] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.810102] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1309.003779] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1309.003779] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.492914] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1310.493306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.082369] env[69847]: INFO networking_nsxv3.common.synchronization [req-66ea0d99-91d8-4ef6-b40d-191ef7490c03 req-b8d06be5-4f70-47b1-8594-6e91c4bcbede tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1313.082881] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1313.083214] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.083331] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.083414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.083590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.083737] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.083833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.083895] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.084042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.084152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.084257] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.586590] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.089237] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.593065] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.593065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.593065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.593065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.593065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.593065] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be updated. [ 1314.619702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.619941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.619941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.620119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.620339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.628209] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: IN_PROGRESS for 2s [ 1315.327847] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-853 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.328384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.328384] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.328475] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.328765] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.328940] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.329074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.329302] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.329477] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.329711] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1315.329830] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.329943] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.330069] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.330195] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1315.330312] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.330448] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.347776] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.347991] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1315.348097] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.348296] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-853" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.348622] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-478b9c36-6411-4b46-872b-edf2cc82d54a taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.348817] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.348940] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.349240] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.349379] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('478b9c36-6411-4b46-872b-edf2cc82d54a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.852109] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.852380] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.852526] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.852911] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.853106] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.853414] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.853588] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.853769] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.854129] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.854346] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.854779] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.855189] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.855340] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.855664] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.855868] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.856107] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 478b9c36-6411-4b46-872b-edf2cc82d54a is going to be updated. [ 1315.878169] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.878511] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.878684] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.879092] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.879386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.879787] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.585696] env[69847]: INFO networking_nsxv3.common.synchronization [req-7b2b61f3-d4dc-4a75-9ac3-80443a533b32 req-8492410e-26c1-4dfb-b551-2990e602b89d service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 1316.585696] env[69847]: INFO networking_nsxv3.common.synchronization [req-7b2b61f3-d4dc-4a75-9ac3-80443a533b32 req-8492410e-26c1-4dfb-b551-2990e602b89d service nova] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1316.586452] env[69847]: INFO networking_nsxv3.common.synchronization [req-7b2b61f3-d4dc-4a75-9ac3-80443a533b32 req-8492410e-26c1-4dfb-b551-2990e602b89d service nova] Enqueued Resource ID: 478b9c36-6411-4b46-872b-edf2cc82d54a with Priority: HIGHEST for action port [ 1316.586723] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_rules [ 1316.586920] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1316.587011] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 478b9c36-6411-4b46-872b-edf2cc82d54a with Priority: HIGHEST for action port [ 1316.587271] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.587396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.587464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.587651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.587739] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.588550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.588670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.588746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.588869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.589048] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.589193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.589193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.589385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.589385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.589581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.590729] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-478b9c36-6411-4b46-872b-edf2cc82d54a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.590729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.590729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.591192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.591192] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('478b9c36-6411-4b46-872b-edf2cc82d54a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.636797] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 1316.637020] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.092952] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.093147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.093317] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.094240] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 478b9c36-6411-4b46-872b-edf2cc82d54a with status ACTIVE [ 1317.094425] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.094537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.094603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.094807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.094892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.095124] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.095207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.095272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.095424] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.095501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.095680] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.095839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.095839] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.095966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.096051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.096142] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 478b9c36-6411-4b46-872b-edf2cc82d54a is going to be updated. [ 1317.115836] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.116109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.116109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.116379] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.116519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.116725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-478b9c36-6411-4b46-872b-edf2cc82d54a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.598384] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.100443] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.100590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.100668] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.101031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.101031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.101169] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1318.127890] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.128040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.128102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.128337] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.128492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.137450] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1320.149578] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1320.150017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.150017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.150232] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.150448] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.150585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.150663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.150846] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.150940] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.151060] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.151164] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.654650] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.156364] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e7c8712-c7ea-4340-b068-333e83abf23f: rpc.has_security_group_logging(os_id): False [ 1321.178513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.178693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.178749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.178950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.179039] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.179310] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.179426] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.179509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.179732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.179848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.179903] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1321.240982] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.241262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.241344] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.241536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.241730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.254049] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1321.587912] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.587986] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1323.270199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1323.270711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.589255] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.589556] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.548870] env[69847]: INFO networking_nsxv3.common.synchronization [req-d4d524fa-f398-4021-a03c-6196a88ee840 req-8a63b500-a7fc-4706-9253-a92215649776 tempest-ServerActionsTestOtherA-993560345 tempest-ServerActionsTestOtherA-993560345-project-member] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1330.549109] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGHEST for action security_group_members [ 1330.549539] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.549729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.549823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.550163] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.550387] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.550544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.550654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.550981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.551062] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.551202] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.054580] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.054819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.054819] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.055051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.055146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.055377] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.055484] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.055545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.055702] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.055778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.055864] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be updated. [ 1331.088273] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.088273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.088273] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.088497] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.088638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.098703] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: IN_PROGRESS for 2s [ 1332.495627] env[69847]: INFO networking_nsxv3.common.synchronization [req-90158df9-6ede-47b6-a2e1-0aefcc78d54f req-f3b3489f-a097-4ab9-b7eb-50991d6c0f0d tempest-ServersNegativeTestJSON-362728887 tempest-ServersNegativeTestJSON-362728887-project-member] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1332.496180] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGHEST for action security_group_members [ 1332.496517] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.496652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.496723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.496978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.497188] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.497312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.497376] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.497537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.497628] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.498146] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.003231] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.003392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.003474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.003706] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.003812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.004034] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.004145] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.004209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.004377] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.004456] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.004555] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be updated. [ 1333.033380] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.033529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.033637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.033862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.034022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.042639] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: IN_PROGRESS for 2s [ 1333.109525] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e in Status: SUCCESS [ 1333.109700] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e deletion is rescheduled due to dependency. [ 1333.109807] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.052632] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 in Status: SUCCESS [ 1335.052961] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 deletion is rescheduled due to dependency. [ 1335.052961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.465940] env[69847]: INFO networking_nsxv3.common.synchronization [req-d891a138-9595-4c0c-89e3-a0fbb376fb44 req-5b795dd0-2182-4e2d-9871-48aa7a4d577a tempest-ServerActionsTestOtherB-1759814677 tempest-ServerActionsTestOtherB-1759814677-project-member] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1335.466492] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGHEST for action security_group_members [ 1335.467028] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.467028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.467028] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.467210] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.467924] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.467924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.467924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.467924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.467924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.467924] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.969629] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.969825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.969825] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.970085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.970085] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.970270] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.970365] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.970422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.970570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.970640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.970723] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be updated. [ 1336.001616] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.001834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.001834] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.002057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.002195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.010306] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: IN_PROGRESS for 2s [ 1336.253724] env[69847]: INFO networking_nsxv3.common.synchronization [req-f1723ff7-673e-4c8b-b484-fb2ac415833c req-6b306722-d7f3-45bd-99e8-a06d032697ae tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1336.254526] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1336.254526] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.254707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.254707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.254872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.258899] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.259750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.259750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.259750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.259750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.259750] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.764623] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.771161] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.771161] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.771161] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1336.800121] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.800121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.800121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.800121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.800121] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.806205] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1337.221811] env[69847]: INFO networking_nsxv3.common.synchronization [req-da0371af-d730-4981-97a3-0a1306aa0fd2 req-664f5b44-e954-432c-b590-1585ad2d85ec tempest-AttachVolumeShelveTestJSON-2087578841 tempest-AttachVolumeShelveTestJSON-2087578841-project-member] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1337.222328] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGHEST for action security_group_members [ 1337.222682] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.222821] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.222886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.223097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.223247] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.223341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.223404] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.223697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.223697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.223850] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.725884] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.726242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.726242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.726339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.726423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.726669] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.726784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.726784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.726879] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.726958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.727051] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc is going to be updated. [ 1337.755018] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.755018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.755018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.755018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.755018] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.761553] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: IN_PROGRESS for 2s [ 1338.023403] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e7c8712-c7ea-4340-b068-333e83abf23f in Status: SUCCESS [ 1338.023403] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f deletion is rescheduled due to dependency. [ 1338.023403] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.815354] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1338.815671] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1338.815671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.881168] env[69847]: INFO networking_nsxv3.common.synchronization [req-a37328fe-8d8d-47cd-984e-5174af26e3a3 req-93df4e98-253b-436e-8e54-bea1f5aba6e7 tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1338.881689] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1338.882192] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.882192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.882192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.882360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.882503] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.882622] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.882693] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.882832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.882915] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.883015] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.274414] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.274622] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.274749] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.275638] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.275638] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.275638] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.275638] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.275876] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.275977] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.276362] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1339.276362] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1339.276540] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1339.276540] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1339.276643] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1339.276747] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1339.276898] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1339.298504] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1339.298716] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1339.298871] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1339.299701] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-243" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.300067] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-a43a7824-b1d9-47ca-8210-2715d55bb66e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.300283] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.300425] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.300952] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.300952] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a43a7824-b1d9-47ca-8210-2715d55bb66e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.385397] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.385553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.385623] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.385831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.385921] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.386119] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.386219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.386281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.386429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.386505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.386591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1339.418693] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.418842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.418891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.419094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.419230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.430897] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1339.771431] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 758ad8ee-cafe-416d-bfdf-e705035260dc in Status: SUCCESS [ 1339.771611] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc deletion is rescheduled due to dependency. [ 1339.771722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.803408] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.803641] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.803764] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.804056] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.804210] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.804368] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port a43a7824-b1d9-47ca-8210-2715d55bb66e not found, creating... [ 1339.804629] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.804786] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.804904] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.805140] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.805277] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.805554] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.805710] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.805827] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.806240] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.806383] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.806527] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: a43a7824-b1d9-47ca-8210-2715d55bb66e is going to be created. [ 1339.825435] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.825772] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.825772] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.826389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.826389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.826389] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.513426] env[69847]: INFO networking_nsxv3.common.synchronization [req-a37328fe-8d8d-47cd-984e-5174af26e3a3 req-dbae0076-3739-44ec-bca6-6f46c4e3650f service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1340.513621] env[69847]: INFO networking_nsxv3.common.synchronization [req-a37328fe-8d8d-47cd-984e-5174af26e3a3 req-dbae0076-3739-44ec-bca6-6f46c4e3650f service nova] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1340.513762] env[69847]: INFO networking_nsxv3.common.synchronization [req-a37328fe-8d8d-47cd-984e-5174af26e3a3 req-dbae0076-3739-44ec-bca6-6f46c4e3650f service nova] Enqueued Resource ID: a43a7824-b1d9-47ca-8210-2715d55bb66e with Priority: HIGHEST for action port [ 1340.514040] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_rules [ 1340.514148] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1340.514246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43a7824-b1d9-47ca-8210-2715d55bb66e with Priority: HIGHEST for action port [ 1340.514791] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.514889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.514959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.515682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.515771] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.516995] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.517207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.517445] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a43a7824-b1d9-47ca-8210-2715d55bb66e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.518109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.518245] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.519116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.519116] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a43a7824-b1d9-47ca-8210-2715d55bb66e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.017712] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.018157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.020214] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a43a7824-b1d9-47ca-8210-2715d55bb66e with status ACTIVE [ 1341.020430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.020561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.020777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.020857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.020933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.021125] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.021229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.021285] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.021438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.021520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.021708] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.021828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.021893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.021995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.022092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.022179] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a43a7824-b1d9-47ca-8210-2715d55bb66e is going to be updated. [ 1341.045059] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.045257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.045257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.045701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.045701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.045840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a43a7824-b1d9-47ca-8210-2715d55bb66e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.440405] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1341.440591] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1341.440709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.440865] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.441088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.441270] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.441391] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.441462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.441648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.441742] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.441841] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.944418] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.447037] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.949300] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.949512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.949512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.949746] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.949842] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.949960] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1342.976847] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.977134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.977134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.977290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.977438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.985107] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1344.996862] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1344.996862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.996862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.996862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.996862] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.997355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.997355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.997355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.997355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.997533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.997571] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.499808] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.499969] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.500030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.500247] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.500410] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.500537] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.500687] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.500760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.500843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.500930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.501088] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.501183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.501336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.501378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.501510] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.501605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.501665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.501799] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.501876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.501957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.502053] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.515202] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.515292] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1346.004639] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20f5623-3d28-4e23-9c51-ff9f4ae3c707: rpc.has_security_group_logging(os_id): False [ 1346.022326] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.022462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.022572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.022738] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.022828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.023041] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.023142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.023200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.023346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.023429] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.023611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.023698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.023758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.023893] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.023964] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.024150] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.024238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.024297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.024430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.024502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.024584] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1346.083750] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.083750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.083750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.083750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.083750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.104564] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1346.385886] env[69847]: INFO networking_nsxv3.common.synchronization [req-5eafff76-6cb0-4cfc-8f72-a81d214437c6 req-57cfc8f2-f128-4203-8732-5020913c956c tempest-DeleteServersTestJSON-1433098686 tempest-DeleteServersTestJSON-1433098686-project-member] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1346.385886] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGHEST for action security_group_members [ 1346.385886] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.385886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.385886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.386703] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.387897] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.387897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.387897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.387897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.387897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.387897] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.892881] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.892881] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.892881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.892881] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be updated. [ 1346.919095] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.919253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.919327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.919532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.919910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.928730] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: IN_PROGRESS for 2s [ 1348.118476] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1348.118747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.938115] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c in Status: SUCCESS [ 1348.938115] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c deletion is rescheduled due to dependency. [ 1348.938115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.333613] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1351.333884] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1351.386069] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.386192] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.567588] env[69847]: INFO networking_nsxv3.common.synchronization [req-04fd0197-3364-4756-be76-bb43a7f4c31b req-23a0a5d2-6abe-4f1f-a1b3-4fe38f0d9770 tempest-ServerDiskConfigTestJSON-1354317190 tempest-ServerDiskConfigTestJSON-1354317190-project-member] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1354.568118] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGHEST for action security_group_members [ 1354.568430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.568572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.568647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.568855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.569021] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.569118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.569187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.569321] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.569402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.569493] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.795383] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d21f192e-b671-4fbc-9cf4-4dc911bff2ae None None] Enqueued Resource ID: a374d88f-a188-4eff-81fd-a048e288690a with Priority: HIGHEST for action port [ 1354.795645] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a374d88f-a188-4eff-81fd-a048e288690a with Priority: HIGHEST for action port [ 1354.796557] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-a374d88f-a188-4eff-81fd-a048e288690a taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.796686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a374d88f-a188-4eff-81fd-a048e288690a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.796752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a374d88f-a188-4eff-81fd-a048e288690a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.797022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a374d88f-a188-4eff-81fd-a048e288690a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.797314] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a374d88f-a188-4eff-81fd-a048e288690a',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.071200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.071375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.071432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.071610] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.071701] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.071884] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.071979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.072050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.072199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.072272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.072357] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be updated. [ 1355.097525] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.097723] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.097771] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.097962] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.098126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.106631] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: IN_PROGRESS for 2s [ 1355.299846] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a374d88f-a188-4eff-81fd-a048e288690a [ 1355.300153] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.300303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.300383] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.300613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.301254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.301254] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a374d88f-a188-4eff-81fd-a048e288690a already deleted. [ 1355.301254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a374d88f-a188-4eff-81fd-a048e288690a" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.584974] env[69847]: INFO networking_nsxv3.common.synchronization [None req-0445ef4c-bd03-4dec-b8d6-5fa15ac2ba8a None None] Enqueued Resource ID: 64402f62-df3a-469f-8553-a2cc8dc85aba with Priority: HIGHEST for action port [ 1356.585509] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64402f62-df3a-469f-8553-a2cc8dc85aba with Priority: HIGHEST for action port [ 1356.585801] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-64402f62-df3a-469f-8553-a2cc8dc85aba taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.585919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64402f62-df3a-469f-8553-a2cc8dc85aba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.585982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64402f62-df3a-469f-8553-a2cc8dc85aba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.586452] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64402f62-df3a-469f-8553-a2cc8dc85aba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.586536] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64402f62-df3a-469f-8553-a2cc8dc85aba',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.088910] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64402f62-df3a-469f-8553-a2cc8dc85aba [ 1357.089230] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.089375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.089449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.090032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.090032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.090032] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64402f62-df3a-469f-8553-a2cc8dc85aba already deleted. [ 1357.090032] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64402f62-df3a-469f-8553-a2cc8dc85aba" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.117014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 in Status: SUCCESS [ 1357.117250] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 deletion is rescheduled due to dependency. [ 1357.117378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.586841] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.586841] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.678610] env[69847]: INFO networking_nsxv3.common.synchronization [req-20ee3c04-b23e-490f-909d-a38f6e38ca54 req-d73b15bc-8091-4547-b2ab-7af655aa4eeb tempest-ServerTagsTestJSON-332301322 tempest-ServerTagsTestJSON-332301322-project-member] Enqueued Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_members [ 1361.679148] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_members [ 1361.679452] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.679573] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.679638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.679892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.680175] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.680298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.680360] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.680514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.680599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.680691] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.936147] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.936353] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.936478] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.936744] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.937037] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.937213] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.937334] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.937548] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.937714] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.937932] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1361.938060] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1361.938174] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1361.938283] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1361.938394] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1361.938502] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1361.938632] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1361.958571] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1361.958795] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1361.958940] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1361.959122] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-808" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.959410] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-8356eba2-ffa4-491f-9944-51dac5bba96e taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.959575] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.959698] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.960009] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.960150] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8356eba2-ffa4-491f-9944-51dac5bba96e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.182573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.182760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.182830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.183058] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.183144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.183332] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.183447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.183482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.183619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.183691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.183772] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e already deleted. [ 1362.183851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.462537] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.462745] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.462884] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.463162] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.463317] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.463585] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 8356eba2-ffa4-491f-9944-51dac5bba96e not found, creating... [ 1362.463748] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.463972] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.464064] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.464269] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.464410] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.464691] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.464850] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.464968] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.465223] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.465365] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.465508] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 8356eba2-ffa4-491f-9944-51dac5bba96e is going to be created. [ 1362.485826] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.486046] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.486176] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.486425] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.486652] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.486873] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.163525] env[69847]: INFO networking_nsxv3.common.synchronization [req-20ee3c04-b23e-490f-909d-a38f6e38ca54 req-5b10b06b-854a-48d4-b2bc-1f9571175f4a service nova] Enqueued Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_rules [ 1363.163812] env[69847]: INFO networking_nsxv3.common.synchronization [req-20ee3c04-b23e-490f-909d-a38f6e38ca54 req-5b10b06b-854a-48d4-b2bc-1f9571175f4a service nova] Enqueued Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_members [ 1363.163926] env[69847]: INFO networking_nsxv3.common.synchronization [req-20ee3c04-b23e-490f-909d-a38f6e38ca54 req-5b10b06b-854a-48d4-b2bc-1f9571175f4a service nova] Enqueued Resource ID: 8356eba2-ffa4-491f-9944-51dac5bba96e with Priority: HIGHEST for action port [ 1363.164091] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_rules [ 1363.164246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_members [ 1363.164306] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8356eba2-ffa4-491f-9944-51dac5bba96e with Priority: HIGHEST for action port [ 1363.164877] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.165262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.165262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.165528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.165576] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.167011] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.167183] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.167218] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.167414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.167578] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.167740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.167806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.167957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.168054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.168145] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.169195] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-8356eba2-ffa4-491f-9944-51dac5bba96e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.169195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.169195] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.169354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.169354] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8356eba2-ffa4-491f-9944-51dac5bba96e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.671208] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.671438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.671674] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.672543] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8356eba2-ffa4-491f-9944-51dac5bba96e with status ACTIVE [ 1363.672722] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.672837] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.672905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.673153] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.673243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.673412] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.673508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.673562] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.673714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.673803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.673978] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.674080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.674139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.674275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.674346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.674485] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8356eba2-ffa4-491f-9944-51dac5bba96e is going to be updated. [ 1363.694549] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.694752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.694752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.694913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.695057] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.695211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8356eba2-ffa4-491f-9944-51dac5bba96e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.176973] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.678868] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.679046] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.679101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.679314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.679400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.679499] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e is going to be created. [ 1364.700830] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.700970] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.701030] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.701200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.701346] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.709445] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: UNINITIALIZED for 2s [ 1366.290086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.290519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.290519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.290644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.290714] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.719572] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: SUCCESS [ 1366.719789] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.719945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.720177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.720366] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.720485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.720540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.720696] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.720776] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.720863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.720948] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.794027] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.223325] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.223536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.223625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.223902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.224136] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.224280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.224354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.224542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.224636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.224722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.224872] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.224980] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.225045] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.225192] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.225339] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.225459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.225535] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.225641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.225714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.225792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.225878] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.295943] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.729134] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d77d69a7-8f25-4ac2-9118-a14cb208590e: rpc.has_security_group_logging(os_id): False [ 1367.745047] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.745311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.745311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.745395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.745467] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.745679] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.745794] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.745850] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.745991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.746109] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.746267] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.746369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.746406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.746543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.746615] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.746789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.746878] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.746933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.747092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.747165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.747250] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e is going to be created. [ 1367.798199] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1367.798324] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1367.800187] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.800318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.800397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.800576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.800747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.813055] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: IN_PROGRESS for 2s [ 1368.165628] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.165849] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1368.525402] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.525828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.525828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.525928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.538863] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1368.539778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.540598] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1368.590250] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.590475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.590475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.590660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.603739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.604450] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1368.604533] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1368.604622] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1368.641850] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.642070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.642070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.642287] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.643493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.643664] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1368.715306] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.715468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.715570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.715743] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.716072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.716341] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1368.784962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.785187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.785187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.785428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.785648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.786009] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1368.786111] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fefa82bf-be1b-4e2a-9d96-94b63738ba8c', '90e98e92-8284-4e76-b863-496da25fff54', '758ad8ee-cafe-416d-bfdf-e705035260dc', '447511d4-51f2-4b25-94d1-cdabf552a536', '22b9de09-f768-45ef-968d-e8da5a6c24b3', '4ebba71e-a742-472f-8890-25c0bf66f3fa', 'e41d6c35-289a-46b1-9113-0dea949327e3', '0e7c8712-c7ea-4340-b068-333e83abf23f', '787bb710-aa55-4d74-8a05-06d3f5d80ddb', 'b8f57242-fc73-4330-af5c-da599a57f0de', '8274668c-f732-47b5-a698-409c1e7afb7c', '45cc6dd9-4b19-4296-b4c7-99f45d6a0146', '804e0265-2d3b-49e8-899e-80d4d047aae0', 'c523ece5-b863-4da0-bab3-ae503f8fa633', '342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d', 'd77d69a7-8f25-4ac2-9118-a14cb208590e', '777d5afe-018d-46de-82b7-4dde124236a9', 'f20f5623-3d28-4e23-9c51-ff9f4ae3c707', '72471c75-08a5-45be-9362-d9463542469e', 'e1f264c4-f165-4427-b9e3-23d05179073b', '70472fc2-8f2e-4656-96c9-97081b657aa2', '2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e', 'a84f4511-52a2-43f2-996e-119d1f5c4dbd', 'cf911be5-2488-4f40-9c8d-53a9a8a05396', '2390abe6-0ba8-4ab0-8c91-187bd39ef80c', '3c88aae7-5837-4451-89b6-8972ab00f699', 'de342dad-fb8d-4c7b-87ea-595f01e3c6be', '8982c0b6-8a83-4e29-82e9-02c4a6ebebad', 'bd9acc22-8a8b-484a-8e94-b168c183d5d8', 'd49fbfa3-cbed-486e-8169-864e1a046ae7', '6dab7dc1-01c6-41fb-8400-c0b26437fd97', '39d08516-0c16-4674-ac9d-29023bc28795', '8022d569-fc48-4639-a726-38e4b078eac1', '9adcb44b-15db-439a-8e0e-af687bcfa50b', 'a895e100-517f-40a3-99b4-4b43ee1bd032', '2b2d82cb-7e65-491f-8df0-d52a50997ba5', '538bdf43-fa07-48d1-906e-f7fa68a3a739', 'd0084e13-9513-4d73-a5ee-3f7440f23dd3', '320d8032-7c7f-4adf-9aaa-d27d0fb2efff', 'a84f0aee-549d-426e-90a7-d029d63ed8eb', '598796a3-3295-47ec-afb1-170cde7401b5', '4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d', '50dc186b-34b2-45b3-89b7-2dfa7346dc41'} {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1368.786227] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1368.804275] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.804430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.804501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.804786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.804786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.804875] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1368.804947] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1368.805029] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1368.883671] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.883844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.883909] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.884115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.885544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.885544] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1368.885837] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1368.885837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1368.885837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1368.885837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1368.886072] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGH for action security_group_rules [ 1368.886072] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGH for action security_group_rules [ 1368.886072] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGH for action security_group_rules [ 1368.886246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGH for action security_group_rules [ 1368.886246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGH for action security_group_rules [ 1368.886246] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGH for action security_group_rules [ 1368.886419] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGH for action security_group_rules [ 1368.886419] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGH for action security_group_rules [ 1368.886419] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGH for action security_group_rules [ 1368.886582] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGH for action security_group_rules [ 1368.886582] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGH for action security_group_rules [ 1368.886582] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGH for action security_group_rules [ 1368.886760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGH for action security_group_rules [ 1368.886760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGH for action security_group_rules [ 1368.886760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGH for action security_group_rules [ 1368.886760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGH for action security_group_rules [ 1368.887066] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGH for action security_group_rules [ 1368.887066] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGH for action security_group_rules [ 1368.887066] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGH for action security_group_rules [ 1368.887066] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGH for action security_group_rules [ 1368.887066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.825755] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: SUCCESS [ 1369.826162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.167310] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.167615] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1373.167615] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c with Priority: HIGH for action security_group_rules [ 1373.167739] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758ad8ee-cafe-416d-bfdf-e705035260dc with Priority: HIGH for action security_group_rules [ 1373.167867] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41d6c35-289a-46b1-9113-0dea949327e3 with Priority: HIGH for action security_group_rules [ 1373.167986] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d with Priority: HIGH for action security_group_rules [ 1373.168108] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1f264c4-f165-4427-b9e3-23d05179073b with Priority: HIGH for action security_group_rules [ 1373.168223] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72471c75-08a5-45be-9362-d9463542469e with Priority: HIGH for action security_group_rules [ 1373.168326] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 with Priority: HIGH for action security_group_rules [ 1373.168418] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 777d5afe-018d-46de-82b7-4dde124236a9 with Priority: HIGH for action security_group_rules [ 1373.168532] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c523ece5-b863-4da0-bab3-ae503f8fa633 with Priority: HIGH for action security_group_rules [ 1373.168627] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGH for action security_group_rules [ 1373.168739] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 with Priority: HIGH for action security_group_rules [ 1373.168843] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 with Priority: HIGH for action security_group_rules [ 1373.168934] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8274668c-f732-47b5-a698-409c1e7afb7c with Priority: HIGH for action security_group_rules [ 1373.169046] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8f57242-fc73-4330-af5c-da599a57f0de with Priority: HIGH for action security_group_rules [ 1373.169155] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb with Priority: HIGH for action security_group_rules [ 1373.169267] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa with Priority: HIGH for action security_group_rules [ 1373.169386] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7c8712-c7ea-4340-b068-333e83abf23f with Priority: HIGH for action security_group_rules [ 1373.169477] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 with Priority: HIGH for action security_group_rules [ 1373.169581] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e98e92-8284-4e76-b863-496da25fff54 with Priority: HIGH for action security_group_rules [ 1373.169678] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447511d4-51f2-4b25-94d1-cdabf552a536 with Priority: HIGH for action security_group_rules [ 1373.170064] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.170209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.170312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.170542] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.170631] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa82bf-be1b-4e2a-9d96-94b63738ba8c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.171644] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-758ad8ee-cafe-416d-bfdf-e705035260dc taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.171787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.171858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.172055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.172132] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('758ad8ee-cafe-416d-bfdf-e705035260dc',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.172905] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e41d6c35-289a-46b1-9113-0dea949327e3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.173047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.173117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.173293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.173365] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e41d6c35-289a-46b1-9113-0dea949327e3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.174259] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.174374] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.174440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.174609] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.174685] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.175403] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1f264c4-f165-4427-b9e3-23d05179073b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.175527] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.175593] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.175768] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.175842] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1f264c4-f165-4427-b9e3-23d05179073b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.176552] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72471c75-08a5-45be-9362-d9463542469e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.176677] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.176726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.176892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.176979] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72471c75-08a5-45be-9362-d9463542469e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.177760] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.177871] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.178170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.178170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.178254] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20f5623-3d28-4e23-9c51-ff9f4ae3c707',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.179067] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-777d5afe-018d-46de-82b7-4dde124236a9 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.179211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.179253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.179389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.179475] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('777d5afe-018d-46de-82b7-4dde124236a9',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.180184] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c523ece5-b863-4da0-bab3-ae503f8fa633 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.180296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.180368] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.180533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.180654] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c523ece5-b863-4da0-bab3-ae503f8fa633',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.181330] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.181459] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.181501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.181671] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.181744] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.182453] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-804e0265-2d3b-49e8-899e-80d4d047aae0 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.182585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.182657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.182817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.182898] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('804e0265-2d3b-49e8-899e-80d4d047aae0',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.183711] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.183832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.183926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.184078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.184154] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cc6dd9-4b19-4296-b4c7-99f45d6a0146',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.184848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8274668c-f732-47b5-a698-409c1e7afb7c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.184998] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.185097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.185217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.185291] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8274668c-f732-47b5-a698-409c1e7afb7c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.185998] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8f57242-fc73-4330-af5c-da599a57f0de taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.186123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.186203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.186354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.186480] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8f57242-fc73-4330-af5c-da599a57f0de',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.187232] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.187364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.187432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.187602] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.187677] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('787bb710-aa55-4d74-8a05-06d3f5d80ddb',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.188397] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ebba71e-a742-472f-8890-25c0bf66f3fa taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.188506] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.188576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.188840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.188840] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ebba71e-a742-472f-8890-25c0bf66f3fa',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.189589] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7c8712-c7ea-4340-b068-333e83abf23f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.189684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.189684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.189927] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.190014] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7c8712-c7ea-4340-b068-333e83abf23f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.190692] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22b9de09-f768-45ef-968d-e8da5a6c24b3 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.190823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.190888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.191071] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.191145] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22b9de09-f768-45ef-968d-e8da5a6c24b3',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.191948] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e98e92-8284-4e76-b863-496da25fff54 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.192113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.192242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.192354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.192443] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e98e92-8284-4e76-b863-496da25fff54',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.193149] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447511d4-51f2-4b25-94d1-cdabf552a536 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.193261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.193362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.193475] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.193553] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447511d4-51f2-4b25-94d1-cdabf552a536',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.220220] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.220398] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.220447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.220652] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.222760] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.222856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.223549] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.223676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.241187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.241325] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e41d6c35-289a-46b1-9113-0dea949327e3 is going to be deleted. [ 1373.242123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.242342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.260536] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.260686] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1f264c4-f165-4427-b9e3-23d05179073b is going to be deleted. [ 1373.261500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.261709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.278439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.278572] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa82bf-be1b-4e2a-9d96-94b63738ba8c is going to be deleted. [ 1373.312585] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.312830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.312830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.312990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.313097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.313216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e41d6c35-289a-46b1-9113-0dea949327e3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.329324] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.329462] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.329509] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.329699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.329784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.329897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1f264c4-f165-4427-b9e3-23d05179073b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.340196] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.340312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.340381] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.340552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.340638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.340750] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa82bf-be1b-4e2a-9d96-94b63738ba8c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.697172] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.697406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.697406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.697592] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.697795] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.697900] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.697950] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.698102] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.698202] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.698299] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.698437] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.772229] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.772442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.772559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.772790] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.774695] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.774820] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.775573] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.775697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.776492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.776630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.777477] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.777603] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.778475] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.778585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.779382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.779498] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.780420] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.780555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.781309] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.781438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.782268] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.782385] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.783124] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.783254] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.783866] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1373.784416] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.784520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.785229] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1373.785708] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.785841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.786566] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1373.787086] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.787252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.788301] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1373.788789] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.788954] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.789808] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1373.790128] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.790268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.803676] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1373.804278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.804494] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 787bb710-aa55-4d74-8a05-06d3f5d80ddb is going to be deleted. [ 1373.805540] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.805798] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.822276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.822415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20f5623-3d28-4e23-9c51-ff9f4ae3c707 is going to be deleted. [ 1373.823448] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.823543] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.849035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.849035] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ebba71e-a742-472f-8890-25c0bf66f3fa is going to be deleted. [ 1373.849461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.849699] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.865243] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.865355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.882201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.882324] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.892091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.892211] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7c8712-c7ea-4340-b068-333e83abf23f is going to be deleted. [ 1373.893054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.893264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.945188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.945391] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8f57242-fc73-4330-af5c-da599a57f0de is going to be deleted. [ 1373.946388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.946618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.950619] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.950728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.970482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.970589] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 804e0265-2d3b-49e8-899e-80d4d047aae0 is going to be deleted. [ 1373.971315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.971514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.007415] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.007530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.009270] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.009382] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22b9de09-f768-45ef-968d-e8da5a6c24b3 is going to be deleted. [ 1374.010143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.010339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.095822] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.096042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.097890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.098082] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 758ad8ee-cafe-416d-bfdf-e705035260dc is going to be deleted. [ 1374.099219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.099492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.164049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.164263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.177682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.177997] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 777d5afe-018d-46de-82b7-4dde124236a9 is going to be deleted. [ 1374.178824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.179054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.196112] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.196248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.206107] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.206107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.206107] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.206323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.206359] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.206470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.206529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.206638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.206721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.206805] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.206946] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.207048] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.207106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.207243] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.207382] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.207530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.207530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.207651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.207713] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.207830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.207930] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.238864] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.239014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8274668c-f732-47b5-a698-409c1e7afb7c is going to be deleted. [ 1374.239876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.240092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.291883] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.292144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.293838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.293937] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d is going to be deleted. [ 1374.294788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.294992] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.339124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.339268] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72471c75-08a5-45be-9362-d9463542469e is going to be deleted. [ 1374.340274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.340496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.386174] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.386295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.393458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.393568] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.403339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.403458] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e98e92-8284-4e76-b863-496da25fff54 is going to be deleted. [ 1374.404342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.404563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.499170] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.499305] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.504339] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.504339] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.512946] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.513045] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cc6dd9-4b19-4296-b4c7-99f45d6a0146 is going to be deleted. [ 1374.513919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.514146] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.577641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.577820] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c523ece5-b863-4da0-bab3-ae503f8fa633 is going to be deleted. [ 1374.578722] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.578966] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.653726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.653887] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447511d4-51f2-4b25-94d1-cdabf552a536 is going to be deleted. [ 1374.654955] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.655187] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.655280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.655400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-787bb710-aa55-4d74-8a05-06d3f5d80ddb" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.655554] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.655704] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.655783] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.655897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20f5623-3d28-4e23-9c51-ff9f4ae3c707" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.656397] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.656599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.656684] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.656817] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ebba71e-a742-472f-8890-25c0bf66f3fa" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.656975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.657143] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.657223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.657386] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7c8712-c7ea-4340-b068-333e83abf23f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.657451] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.657591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.657666] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.657823] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8f57242-fc73-4330-af5c-da599a57f0de" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.657959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.658116] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.658190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.658294] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-804e0265-2d3b-49e8-899e-80d4d047aae0" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.658416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.658553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.658626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.658730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22b9de09-f768-45ef-968d-e8da5a6c24b3" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.658931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.659094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.659170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.659278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-758ad8ee-cafe-416d-bfdf-e705035260dc" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.659396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.659533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.659608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.659714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8274668c-f732-47b5-a698-409c1e7afb7c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.659844] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.660007] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.660094] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.660200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-777d5afe-018d-46de-82b7-4dde124236a9" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.660318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.660461] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.660519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.660625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72471c75-08a5-45be-9362-d9463542469e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.660745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.660916] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.660953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.661050] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-342d0ade-7b4c-4c67-b3c8-5b7e882c1d4d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.665477] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.665477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.665591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.665675] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.665714] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.665868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e98e92-8284-4e76-b863-496da25fff54" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.710293] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d77d69a7-8f25-4ac2-9118-a14cb208590e: rpc.has_security_group_logging(os_id): False [ 1374.713467] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.713598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.713665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.713860] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.713947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.714072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c523ece5-b863-4da0-bab3-ae503f8fa633" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.766740] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.766904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.766904] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.767147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.767242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.767364] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cc6dd9-4b19-4296-b4c7-99f45d6a0146" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.807654] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.807654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.807654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.807654] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.807941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.807941] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447511d4-51f2-4b25-94d1-cdabf552a536" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.837075] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.837223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.837334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.837574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.872394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.872625] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.872734] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.872796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.872979] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.873073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.873276] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.873373] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.873431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.873574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.873647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.873958] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.873958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.873958] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.874147] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.874182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.874313] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e is going to be updated. [ 1375.039793] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.039948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.040042] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.040239] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.040384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.063318] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: IN_PROGRESS for 2s [ 1375.301533] env[69847]: INFO networking_nsxv3.common.synchronization [req-4563c04e-66c7-4f26-b875-77132c52732c req-3c56c97e-a764-4316-8683-1433924bd22d tempest-ServerTagsTestJSON-332301322 tempest-ServerTagsTestJSON-332301322-project-member] Enqueued Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_members [ 1375.302071] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGHEST for action security_group_members [ 1375.302369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.302494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.302552] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.302739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.302886] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.302968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.303035] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.303178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.303307] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.303348] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.806300] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.806449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.806526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.806780] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.806872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.807108] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.807216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.807277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.807450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.807534] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.807644] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e is going to be updated. [ 1375.837713] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.837920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.837920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.838136] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.838272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.848235] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: IN_PROGRESS for 2s [ 1377.075837] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: SUCCESS [ 1377.076211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.857070] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d77d69a7-8f25-4ac2-9118-a14cb208590e in Status: SUCCESS [ 1377.857237] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e deletion is rescheduled due to dependency. [ 1377.857320] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.833405] env[69847]: INFO networking_nsxv3.common.synchronization [req-5c71e8b3-5b88-4466-a3d6-f5795f8f4d31 req-84942320-fe45-4ea7-8dc9-fe311602c9f7 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1378.833405] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1378.834070] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.834204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.834278] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.834477] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.834628] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.834724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.834786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.834930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.835044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.835134] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.338658] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.338658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.338658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.338658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.359721] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.359955] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.360113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.360240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.360450] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.360560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.360673] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1379.390861] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.390978] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.391036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.391253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.391406] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.398858] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1381.409180] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1381.409444] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad deletion is rescheduled due to dependency. [ 1381.409490] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.131557] env[69847]: INFO networking_nsxv3.common.synchronization [None req-4e457963-c33a-4a53-be2f-3057739c87eb None None] Enqueued Resource ID: c26ac6f2-75f4-4736-809c-ded166ca1a42 with Priority: HIGHEST for action port [ 1383.131557] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26ac6f2-75f4-4736-809c-ded166ca1a42 with Priority: HIGHEST for action port [ 1383.132037] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-c26ac6f2-75f4-4736-809c-ded166ca1a42 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.132190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c26ac6f2-75f4-4736-809c-ded166ca1a42" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.132264] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c26ac6f2-75f4-4736-809c-ded166ca1a42" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.132474] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c26ac6f2-75f4-4736-809c-ded166ca1a42" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.132601] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26ac6f2-75f4-4736-809c-ded166ca1a42',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.507957] env[69847]: INFO networking_nsxv3.common.synchronization [None req-75b35591-9039-48c2-a60f-4a0ec8dfe387 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_rules [ 1383.508488] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_rules [ 1383.508783] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.508924] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.508996] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.512033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.512146] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.591137] env[69847]: INFO networking_nsxv3.common.synchronization [None req-8162238a-1af6-4c60-bc03-ec68bde962bb tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_rules [ 1383.591137] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_rules [ 1383.591635] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.592943] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.633972] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c26ac6f2-75f4-4736-809c-ded166ca1a42 [ 1383.634233] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.634384] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.634505] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.634748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.634862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.634976] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c26ac6f2-75f4-4736-809c-ded166ca1a42 already deleted. [ 1383.635157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c26ac6f2-75f4-4736-809c-ded166ca1a42" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.032540] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.032707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.032759] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.033129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.033129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.033223] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d already deleted. [ 1384.033303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.033686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.033686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.033770] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.555454] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.555829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.555829] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.555908] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.556078] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.556156] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d already deleted. [ 1384.556211] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.032388] env[69847]: INFO networking_nsxv3.common.synchronization [None req-91698409-2fe9-45bc-9cc7-98184387aa6a None None] Enqueued Resource ID: 40a5696e-1536-4976-8832-989f97d600e7 with Priority: HIGHEST for action port [ 1385.032653] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a5696e-1536-4976-8832-989f97d600e7 with Priority: HIGHEST for action port [ 1385.033223] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-40a5696e-1536-4976-8832-989f97d600e7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.033390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40a5696e-1536-4976-8832-989f97d600e7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.033514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40a5696e-1536-4976-8832-989f97d600e7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.033727] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40a5696e-1536-4976-8832-989f97d600e7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.033819] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a5696e-1536-4976-8832-989f97d600e7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.536204] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40a5696e-1536-4976-8832-989f97d600e7 [ 1385.537024] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.537024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.537024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.537024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.537024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.537024] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40a5696e-1536-4976-8832-989f97d600e7 already deleted. [ 1385.537390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40a5696e-1536-4976-8832-989f97d600e7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.840550] env[69847]: INFO networking_nsxv3.common.synchronization [req-fbbd9cd8-311d-4d1f-9716-eec723a18bad req-7c7b9576-fc28-4dc1-a7d7-9c331b7b8e06 tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1385.841070] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1385.841370] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.841739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.841739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.841739] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.841965] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.842077] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.842133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.842280] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.842361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.842450] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.094130] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.095028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.095028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.095028] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.095028] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.095304] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.095304] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.095491] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.095640] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.095856] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1386.095972] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1386.096098] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1386.096211] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1386.096324] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1386.096432] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1386.096565] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1386.114224] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1386.114379] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1386.114515] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1386.114672] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-392" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.114938] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-4a811635-ffc2-47bf-98b6-ec09897bdd36 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.115114] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.115239] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.115516] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.115654] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a811635-ffc2-47bf-98b6-ec09897bdd36',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.347944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.348157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.348157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.348362] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.348455] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.348655] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.348782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.348848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.349041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.349126] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.349214] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1386.374941] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.375133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.375198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.375356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.375482] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.384115] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1386.618111] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.618359] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.618490] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.618773] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.618955] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.619127] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 4a811635-ffc2-47bf-98b6-ec09897bdd36 not found, creating... [ 1386.619403] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.619562] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.619682] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.619910] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.620069] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.620359] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.620517] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.620635] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.620844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.620988] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.621145] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 4a811635-ffc2-47bf-98b6-ec09897bdd36 is going to be created. [ 1386.714462] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.714777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.714923] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.715221] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.715450] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.715692] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.323485] env[69847]: INFO networking_nsxv3.common.synchronization [req-fbbd9cd8-311d-4d1f-9716-eec723a18bad req-dd6f0ecd-b8bf-4aca-8b86-d5f8e44cd4d6 service nova] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 1387.323723] env[69847]: INFO networking_nsxv3.common.synchronization [req-fbbd9cd8-311d-4d1f-9716-eec723a18bad req-dd6f0ecd-b8bf-4aca-8b86-d5f8e44cd4d6 service nova] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1387.323758] env[69847]: INFO networking_nsxv3.common.synchronization [req-fbbd9cd8-311d-4d1f-9716-eec723a18bad req-dd6f0ecd-b8bf-4aca-8b86-d5f8e44cd4d6 service nova] Enqueued Resource ID: 4a811635-ffc2-47bf-98b6-ec09897bdd36 with Priority: HIGHEST for action port [ 1387.323971] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_rules [ 1387.324122] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1387.324218] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a811635-ffc2-47bf-98b6-ec09897bdd36 with Priority: HIGHEST for action port [ 1387.324904] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.325142] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.325261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.325492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.325609] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.326478] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.326616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.326865] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a811635-ffc2-47bf-98b6-ec09897bdd36 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.327007] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.327103] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.327295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.327402] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a811635-ffc2-47bf-98b6-ec09897bdd36',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.829913] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.830082] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.830292] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a811635-ffc2-47bf-98b6-ec09897bdd36 with status ACTIVE [ 1387.830457] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.830898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.830898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.830898] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.831074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.831119] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.831236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.831296] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.831471] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.832065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.832065] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.832065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.832065] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.832303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.832303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.832303] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a811635-ffc2-47bf-98b6-ec09897bdd36 is going to be updated. [ 1387.850953] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.851135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.851188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.851357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.851493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.851644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a811635-ffc2-47bf-98b6-ec09897bdd36" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.393027] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1388.393326] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad deletion is rescheduled due to dependency. [ 1388.393326] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.393464] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.393676] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.393850] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.393968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.394043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.394198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.394281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.394374] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.897762] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.069695] env[69847]: INFO networking_nsxv3.common.synchronization [req-e0ef2090-8b14-4139-b471-693e6b640bb1 req-22494c66-42b2-43fc-b62a-fdd9c68fb9e5 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_members [ 1389.070206] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_members [ 1389.070509] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.070631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.070698] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.071193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.071193] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.071193] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.071387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.071387] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.071468] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.071561] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.320722] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.320939] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.321083] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.321462] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.321731] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.321894] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.322032] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.322308] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.322525] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.322762] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1389.322894] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1389.323025] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1389.323154] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1389.323269] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1389.323394] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1389.323525] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1389.340614] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1389.340762] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1389.340893] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1389.341072] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.341347] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.341509] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.341631] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.341917] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.342076] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dbbf2f2-37df-4c13-8739-2e6a43c2be5d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.400479] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.573787] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.573931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.573982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.574221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.574295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.574468] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.574599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.574663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.574811] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.574887] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.574973] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d already deleted. [ 1389.575303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.845074] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.845074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.845074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.845074] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.845295] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.845335] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 3dbbf2f2-37df-4c13-8739-2e6a43c2be5d not found, creating... [ 1389.845586] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.845745] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.845864] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.846107] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.846247] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.846521] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.846676] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.846793] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.846996] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.847143] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.847279] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 3dbbf2f2-37df-4c13-8739-2e6a43c2be5d is going to be created. [ 1389.868204] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.868414] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.868542] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.868796] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.869038] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.869261] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.902009] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.902174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.902226] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.902413] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.902500] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.902592] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1389.927072] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.927238] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.927309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.927440] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.927574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.935071] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1390.538898] env[69847]: INFO networking_nsxv3.common.synchronization [req-e0ef2090-8b14-4139-b471-693e6b640bb1 req-95d951a8-781d-4a28-92fc-3d2afd395f8b service nova] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_rules [ 1390.539190] env[69847]: INFO networking_nsxv3.common.synchronization [req-e0ef2090-8b14-4139-b471-693e6b640bb1 req-95d951a8-781d-4a28-92fc-3d2afd395f8b service nova] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_members [ 1390.539231] env[69847]: INFO networking_nsxv3.common.synchronization [req-e0ef2090-8b14-4139-b471-693e6b640bb1 req-95d951a8-781d-4a28-92fc-3d2afd395f8b service nova] Enqueued Resource ID: 3dbbf2f2-37df-4c13-8739-2e6a43c2be5d with Priority: HIGHEST for action port [ 1390.539455] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_rules [ 1390.539580] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_members [ 1390.539674] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dbbf2f2-37df-4c13-8739-2e6a43c2be5d with Priority: HIGHEST for action port [ 1390.540737] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.540868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.540933] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.541157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.541239] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.542052] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.542159] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.542215] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.542347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.542487] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.542574] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.542630] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.542767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.542849] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.542934] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.543600] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.543711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.543765] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.543896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.543972] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dbbf2f2-37df-4c13-8739-2e6a43c2be5d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.045500] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.045642] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.046944] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.047804] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dbbf2f2-37df-4c13-8739-2e6a43c2be5d with status ACTIVE [ 1391.048051] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.048179] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.048241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.048435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.048522] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.048691] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.048795] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.048885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.049129] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.049263] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.049464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.049539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.049591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.049752] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.049882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.049987] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dbbf2f2-37df-4c13-8739-2e6a43c2be5d is going to be updated. [ 1391.070015] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.070173] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.070231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.070466] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.070561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.070715] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dbbf2f2-37df-4c13-8739-2e6a43c2be5d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.552493] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.944747] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1391.944937] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.945130] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.945359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.945550] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.945681] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.945728] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.945876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.945959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.946055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.946146] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.054525] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.054740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.054740] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.055079] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.055229] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.055309] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d is going to be created. [ 1392.077053] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.077290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.077355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.077539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.077697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.086362] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d in Status: UNINITIALIZED for 2s [ 1392.448393] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.951314] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8982c0b6-8a83-4e29-82e9-02c4a6ebebad: rpc.has_security_group_logging(os_id): False [ 1392.968239] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.968417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.968476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.968657] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.968744] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.968983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.969106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.969174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.969327] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.969402] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.969488] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1393.024181] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.024334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.024389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.024591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.024730] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.035804] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1394.094695] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d in Status: SUCCESS [ 1394.095043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.095112] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.095281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.095466] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.095585] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.095648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.095792] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.095872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.095959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.096084] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.598347] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.050227] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1395.050431] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.100915] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c1656bc-eaa3-40e0-9c81-d06925a9350d: rpc.has_security_group_logging(os_id): False [ 1395.118456] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.118588] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.118647] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.118868] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.118957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.119379] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.119465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.119519] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.119691] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.119774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.119864] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d is going to be created. [ 1395.173369] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.173606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.173606] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.173784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.173960] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.183326] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d in Status: IN_PROGRESS for 2s [ 1395.540479] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.540647] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1397.195798] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d in Status: SUCCESS [ 1397.196231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.541498] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.541941] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.542578] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.542578] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.543456] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.543806] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.544813] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.545224] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.546501] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.546838] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.547573] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.547965] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.549363] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.549780] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.550759] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.551184] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.552191] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.552565] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.160985] env[69847]: INFO networking_nsxv3.common.synchronization [None req-b1bc00f6-b1ca-44b4-b2b2-4edc92e06030 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_rules [ 1444.161499] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_rules [ 1444.162196] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.162341] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.162409] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.162663] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.162748] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1444.222297] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d75d89ee-eb0b-44ae-a885-fa95c9f3b65f tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_rules [ 1444.222297] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_rules [ 1444.222297] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.222297] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.682831] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.683009] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.683069] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.683268] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.683357] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.683448] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 609c743a-8d95-49f2-950a-deac8685a390 already deleted. [ 1444.683533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.683685] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.683873] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.683958] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.210903] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.211312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.211312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.211439] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.211544] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.211641] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 609c743a-8d95-49f2-950a-deac8685a390 already deleted. [ 1445.211725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.919609] env[69847]: INFO networking_nsxv3.common.synchronization [req-58534a1b-acbf-4b2b-b20d-fbdd671409d7 req-1bf2d63e-9930-44a8-9cdb-05eea56019ce tempest-ServerActionsTestJSON-640017276 tempest-ServerActionsTestJSON-640017276-project-member] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1445.920344] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGHEST for action security_group_members [ 1445.920818] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.921371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.921371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.921637] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.921698] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.921863] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.921984] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.922259] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.922412] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.922581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.425096] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.425487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.425487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.425594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.425594] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.425791] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.425884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.425925] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.426092] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.426185] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.426255] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be updated. [ 1446.452797] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.452944] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.452990] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.453182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.453315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.460869] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: IN_PROGRESS for 2s [ 1448.471860] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad in Status: SUCCESS [ 1448.472267] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad deletion is rescheduled due to dependency. [ 1448.472267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.557128] env[69847]: INFO networking_nsxv3.common.synchronization [req-bfdf53cd-5dc8-4514-91d8-acd7a72d3508 req-607da3bf-a261-45b9-a2ae-818ee135fe96 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_members [ 1449.557496] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_members [ 1449.557754] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.557848] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.557913] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.558174] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.558330] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.558423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.558479] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.558644] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.558732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.558823] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.834551] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.834742] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.834868] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.835151] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.835442] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.835602] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.835721] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.835937] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.836100] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.836324] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1449.836438] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1449.836547] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1449.836673] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1449.836807] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1449.836919] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1449.837059] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1449.856377] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1449.856525] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1449.856674] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1449.856844] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.857113] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-f2ce3e1b-d90e-445c-ae16-7033edcd701f taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.857273] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.857395] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.857671] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.857813] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ce3e1b-d90e-445c-ae16-7033edcd701f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.061355] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.061530] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.061613] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.061769] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.061854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.062057] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.062200] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.062274] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.062366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.062434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.062523] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 609c743a-8d95-49f2-950a-deac8685a390 already deleted. [ 1450.062600] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.360376] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.361039] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.361211] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.361517] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.361704] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.362014] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port f2ce3e1b-d90e-445c-ae16-7033edcd701f not found, creating... [ 1450.362385] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.362583] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.362712] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.362982] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.363164] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.363463] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.363627] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.363766] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.364015] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.364161] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.364322] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: f2ce3e1b-d90e-445c-ae16-7033edcd701f is going to be created. [ 1450.383748] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.383954] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.384096] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.384359] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.384593] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.384815] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.042574] env[69847]: INFO networking_nsxv3.common.synchronization [req-bfdf53cd-5dc8-4514-91d8-acd7a72d3508 req-514ff7ad-616a-4b96-82ac-823746986e57 service nova] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_rules [ 1451.042856] env[69847]: INFO networking_nsxv3.common.synchronization [req-bfdf53cd-5dc8-4514-91d8-acd7a72d3508 req-514ff7ad-616a-4b96-82ac-823746986e57 service nova] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_members [ 1451.043025] env[69847]: INFO networking_nsxv3.common.synchronization [req-bfdf53cd-5dc8-4514-91d8-acd7a72d3508 req-514ff7ad-616a-4b96-82ac-823746986e57 service nova] Enqueued Resource ID: f2ce3e1b-d90e-445c-ae16-7033edcd701f with Priority: HIGHEST for action port [ 1451.043143] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_rules [ 1451.043277] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_members [ 1451.043371] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2ce3e1b-d90e-445c-ae16-7033edcd701f with Priority: HIGHEST for action port [ 1451.043914] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.044053] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.044131] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.044322] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.044401] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.045200] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.045309] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.045375] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.045532] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.045680] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.045756] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.045830] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.046024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.046024] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.046139] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.046836] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2ce3e1b-d90e-445c-ae16-7033edcd701f taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.046949] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.047026] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.047162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.047232] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2ce3e1b-d90e-445c-ae16-7033edcd701f',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.549338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.549478] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.549663] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1451.551128] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2ce3e1b-d90e-445c-ae16-7033edcd701f with status ACTIVE [ 1451.551919] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.551919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.551919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.551919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.551919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.552216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.552216] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.552311] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.552447] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.552555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.552762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.552891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.552971] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.553167] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.553279] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.553375] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2ce3e1b-d90e-445c-ae16-7033edcd701f is going to be updated. [ 1451.573703] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.573875] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.573926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.574133] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.574277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.574434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2ce3e1b-d90e-445c-ae16-7033edcd701f" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.051715] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.556605] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.556747] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.556802] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.557015] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.557115] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.557215] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 609c743a-8d95-49f2-950a-deac8685a390 is going to be created. [ 1452.579759] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.579942] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.580037] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.580240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.580395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.588998] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 609c743a-8d95-49f2-950a-deac8685a390 in Status: UNINITIALIZED for 2s [ 1454.598873] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 609c743a-8d95-49f2-950a-deac8685a390 in Status: SUCCESS [ 1454.599256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.599256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.599423] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.599583] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.599712] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.599784] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.599939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.600031] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.600117] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.600206] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.102842] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.604941] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 609c743a-8d95-49f2-950a-deac8685a390: rpc.has_security_group_logging(os_id): False [ 1455.621350] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.621507] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.621561] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.621748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.621838] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.622093] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.622197] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.622262] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.622417] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.622493] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.622597] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 609c743a-8d95-49f2-950a-deac8685a390 is going to be created. [ 1455.680560] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.680733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.680733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.680905] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.681123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.690102] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 609c743a-8d95-49f2-950a-deac8685a390 in Status: IN_PROGRESS for 2s [ 1456.044099] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.044254] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1457.701816] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 609c743a-8d95-49f2-950a-deac8685a390 in Status: SUCCESS [ 1457.702253] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.045244] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.045676] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.046402] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.046845] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.047179] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.047577] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.048358] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.048823] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.049207] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.049562] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.049960] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.050433] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.051307] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.051731] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.052837] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.053241] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.640024] env[69847]: INFO networking_nsxv3.common.synchronization [req-f136a02d-7dc6-4f5d-ac52-9755e88b06fc req-6076773f-6fd5-48da-945b-83ecd65bbc6f tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_members [ 1499.640542] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGHEST for action security_group_members [ 1499.640845] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.640975] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.641041] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.641227] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.642197] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.642330] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.642396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.642570] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.642656] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.643191] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.145937] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.146134] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.146209] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.146394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.146488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.146676] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.146774] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.146833] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.146974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.147066] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.147172] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 609c743a-8d95-49f2-950a-deac8685a390 is going to be updated. [ 1500.175260] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.175414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.175414] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.175547] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.175697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.182959] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 609c743a-8d95-49f2-950a-deac8685a390 in Status: IN_PROGRESS for 2s [ 1502.192847] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 609c743a-8d95-49f2-950a-deac8685a390 in Status: SUCCESS [ 1502.193298] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 609c743a-8d95-49f2-950a-deac8685a390 deletion is rescheduled due to dependency. [ 1502.193298] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.641677] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.642128] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.642497] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.642742] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.885053] env[69847]: INFO networking_nsxv3.common.synchronization [req-bfe3943d-4fee-4965-bd23-ae18ed1616d5 req-914101d2-5346-4965-8132-cbd47391abe1 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_members [ 1510.885628] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGHEST for action security_group_members [ 1510.885969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.886140] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.886230] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.886472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.886660] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.886803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.886884] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.887080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.887170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.887340] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.389500] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.389778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.389778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.389974] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.390093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.390303] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.390415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.390496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.390616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.390697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.390782] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d is going to be updated. [ 1511.423823] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.424033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.424033] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.424184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.424316] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.431581] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d in Status: IN_PROGRESS for 2s [ 1513.442758] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d in Status: SUCCESS [ 1513.443184] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d deletion is rescheduled due to dependency. [ 1513.443184] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.525590] env[69847]: INFO networking_nsxv3.common.synchronization [None req-f522f5e5-4422-425a-9397-d28ec8349855 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_rules [ 1515.526130] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_rules [ 1515.526430] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.526533] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.526631] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.526892] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.526977] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.587571] env[69847]: INFO networking_nsxv3.common.synchronization [None req-48e00606-1796-4a2a-9070-fddc11118fb1 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_rules [ 1515.588054] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_rules [ 1515.588516] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.588516] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.046821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.046982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.047043] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.047236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.047325] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.047439] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b already deleted. [ 1516.047524] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.047664] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.047818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.047900] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.569398] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.569841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.569841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.569841] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.569982] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.570033] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b already deleted. [ 1516.570118] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.588867] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.589229] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.745745] env[69847]: INFO networking_nsxv3.common.synchronization [req-a0b17169-5586-4a3e-b03f-aa0da477f877 req-9544aa87-88d0-48d4-97f6-f3fcb32436f0 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_members [ 1520.746266] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_members [ 1520.746556] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.746697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.746760] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.747016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.747298] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1520.747425] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1520.747502] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1520.747711] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1520.747803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.747900] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.001171] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.001386] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.001514] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.001782] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.002101] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.002270] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.002390] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.002606] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.002755] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.002982] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1521.003117] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1521.003238] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1521.003349] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1521.003464] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1521.003571] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1521.003707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1521.023359] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1521.023506] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1521.023646] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1521.023810] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.024143] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-31f7d5e5-415a-4862-bd59-e066d7770331 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.024316] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.024438] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.024717] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.024857] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31f7d5e5-415a-4862-bd59-e066d7770331',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1521.250338] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.250564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.250564] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.250751] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.250843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.251043] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.251144] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.251199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.251354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.251428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.251514] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b already deleted. [ 1521.251626] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.526564] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.526777] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.526910] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.527214] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.527391] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.527556] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port 31f7d5e5-415a-4862-bd59-e066d7770331 not found, creating... [ 1521.527812] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.527974] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.528109] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.528327] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.528466] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.528752] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.528909] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.529036] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.529247] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.529380] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.529580] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: 31f7d5e5-415a-4862-bd59-e066d7770331 is going to be created. [ 1521.550972] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1521.551150] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1521.551273] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1521.551479] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1521.551687] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.551914] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.204859] env[69847]: INFO networking_nsxv3.common.synchronization [req-a0b17169-5586-4a3e-b03f-aa0da477f877 req-65b199fe-3979-4c4b-b4da-935e413a6f41 service nova] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_rules [ 1522.205101] env[69847]: INFO networking_nsxv3.common.synchronization [req-a0b17169-5586-4a3e-b03f-aa0da477f877 req-65b199fe-3979-4c4b-b4da-935e413a6f41 service nova] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_members [ 1522.205196] env[69847]: INFO networking_nsxv3.common.synchronization [req-a0b17169-5586-4a3e-b03f-aa0da477f877 req-65b199fe-3979-4c4b-b4da-935e413a6f41 service nova] Enqueued Resource ID: 31f7d5e5-415a-4862-bd59-e066d7770331 with Priority: HIGHEST for action port [ 1522.205394] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_rules [ 1522.205520] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_members [ 1522.205615] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31f7d5e5-415a-4862-bd59-e066d7770331 with Priority: HIGHEST for action port [ 1522.206298] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.206465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.206572] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.206808] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.206935] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.207851] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.208038] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.208204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.208388] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.208582] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.208725] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.208824] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.209017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.209157] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.213038] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.214139] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-31f7d5e5-415a-4862-bd59-e066d7770331 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.214335] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.214453] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.214646] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.214768] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31f7d5e5-415a-4862-bd59-e066d7770331',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.716629] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.718161] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.718301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.718348] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31f7d5e5-415a-4862-bd59-e066d7770331 with status ACTIVE [ 1522.718523] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.718658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.718981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.718981] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.719166] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.719209] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.719323] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.719390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.719501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.719579] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.719762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.719910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.719910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.720091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.720162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.720251] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31f7d5e5-415a-4862-bd59-e066d7770331 is going to be updated. [ 1522.742316] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.742512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.742512] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.742661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.742781] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.742930] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31f7d5e5-415a-4862-bd59-e066d7770331" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.222057] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.727389] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.727501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.727581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.727782] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.727876] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.727958] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b is going to be created. [ 1523.751876] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.752081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.752081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.752276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.752428] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.760691] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b in Status: UNINITIALIZED for 2s [ 1525.770330] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b in Status: SUCCESS [ 1525.770729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.770729] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.770920] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.771124] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.771242] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.771304] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.771465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.771549] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.771635] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.771726] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.274140] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1526.776707] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2faa2-25e1-421a-a969-531c3d6a9f5b: rpc.has_security_group_logging(os_id): False [ 1526.794617] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.794758] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.794806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.795029] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.795123] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.795355] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.795457] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.795520] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.795710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.795791] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.795876] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b is going to be created. [ 1526.854263] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1526.854395] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1526.854442] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1526.854598] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1526.854770] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1526.863970] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b in Status: IN_PROGRESS for 2s [ 1527.206935] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.207142] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1528.878803] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b in Status: SUCCESS [ 1528.879206] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.208285] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.208676] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.209316] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.209316] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.210644] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.210961] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.211865] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.212257] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.213232] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.213619] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1557.213917] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.214318] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.214761] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.215219] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.215743] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.216140] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.217025] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.217504] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.218627] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.218937] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.220014] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.220400] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.714530] env[69847]: INFO networking_nsxv3.common.synchronization [req-242f6148-1af0-4d0d-85ed-a70a56fe3bab req-e77ffbd3-5d42-478b-95c5-afeec28ab9e5 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_members [ 1582.715083] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGHEST for action security_group_members [ 1582.715406] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.715538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.715608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.716354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.716354] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.716354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.716354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.716354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.716354] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.716605] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.218728] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.218919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.218957] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.219190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.219286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.219497] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.219597] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.219658] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.219812] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.219888] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.219973] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b is going to be updated. [ 1583.255829] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.256158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.256158] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.256219] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.256333] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.264230] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b in Status: IN_PROGRESS for 2s [ 1585.274888] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b in Status: SUCCESS [ 1585.275271] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b deletion is rescheduled due to dependency. [ 1585.275271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.292122] env[69847]: INFO networking_nsxv3.common.synchronization [None req-9ab3576d-2042-4291-8389-c3954f30891d tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_rules [ 1587.292362] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_rules [ 1587.292592] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.292755] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.292843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.293271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.293405] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1587.354064] env[69847]: INFO networking_nsxv3.common.synchronization [None req-d0a38db3-712e-418c-a0ae-211c591a3415 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_rules [ 1587.354064] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_rules [ 1587.354513] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.354616] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.813962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.814119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.814191] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.814396] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.814488] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.814580] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b already deleted. [ 1587.814662] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.814797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.814948] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.815039] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.333995] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.334366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.334366] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.334432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.334496] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.334591] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b already deleted. [ 1588.334672] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.334876] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1591.334876] env[69847]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-75e223ae-d828-4210-922b-7433d133c789 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1592.357605] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.357935] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1592.499343] env[69847]: INFO networking_nsxv3.common.synchronization [req-f5e0b235-a1c3-4041-806a-2fa35ca7126a req-f62d16d9-e604-4138-a3db-0b0de87f4c86 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_members [ 1592.499851] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_members [ 1592.500178] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.500328] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.500401] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.500670] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.500788] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.500891] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.500959] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.501097] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.501178] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.501270] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1592.801597] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.801834] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.801930] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.802205] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.802459] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.802629] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.802723] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.802943] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.803105] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.803331] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1592.803447] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] NeedRegenerationException {{(pid=69847) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1592.803555] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] no value, waiting for create lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1592.803663] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] value creation lock acquired {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1592.803773] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] No value present for key: 'zone-id' {{(pid=69847) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1592.803879] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Calling creation function for not-yet-present value {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1592.804021] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1592.824141] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1592.824329] env[69847]: DEBUG dogpile.cache.region [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69847) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1592.824435] env[69847]: DEBUG dogpile.lock [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Released creation lock {{(pid=69847) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1592.824608] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "network-269" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.824907] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock port-b4f07f8c-58a0-4369-b9ed-00b0385fda59 taken with stack trace [, , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1592.825080] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1592.825202] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1592.825520] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1592.825662] env[69847]: DEBUG networking_nsxv3.api.rpc [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f07f8c-58a0-4369-b9ed-00b0385fda59',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1593.004053] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.004217] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.004267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.004449] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.004538] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.004733] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.004843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.004889] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.005090] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.005170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.005229] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b already deleted. [ 1593.005289] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.327583] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.327812] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.327942] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.328249] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.328403] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.328566] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Segment Port b4f07f8c-58a0-4369-b9ed-00b0385fda59 not found, creating... [ 1593.328830] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.328992] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.329130] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.329376] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.329496] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.329783] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.329950] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.330075] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.330290] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.330456] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.330606] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Resource: SegmentPort with ID: b4f07f8c-58a0-4369-b9ed-00b0385fda59 is going to be created. [ 1593.351604] env[69847]: DEBUG networking_nsxv3.common.locking [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1593.351863] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1593.351932] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1593.352219] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1593.352833] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1593.352833] env[69847]: DEBUG oslo_concurrency.lockutils [None req-9174b7bc-7b72-45e9-9897-bff399aaa6fb None None] Releasing lock "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.011256] env[69847]: INFO networking_nsxv3.common.synchronization [req-f5e0b235-a1c3-4041-806a-2fa35ca7126a req-c4d038cc-2b47-493a-a364-f14bc275783a service nova] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_rules [ 1594.011566] env[69847]: INFO networking_nsxv3.common.synchronization [req-f5e0b235-a1c3-4041-806a-2fa35ca7126a req-c4d038cc-2b47-493a-a364-f14bc275783a service nova] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_members [ 1594.011599] env[69847]: INFO networking_nsxv3.common.synchronization [req-f5e0b235-a1c3-4041-806a-2fa35ca7126a req-c4d038cc-2b47-493a-a364-f14bc275783a service nova] Enqueued Resource ID: b4f07f8c-58a0-4369-b9ed-00b0385fda59 with Priority: HIGHEST for action port [ 1594.011805] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_rules [ 1594.011931] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_members [ 1594.012041] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4f07f8c-58a0-4369-b9ed-00b0385fda59 with Priority: HIGHEST for action port [ 1594.012569] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.012736] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.012767] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.012938] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.013033] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.013821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.013929] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.013995] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.014182] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.014323] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.014415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.014476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.014608] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.014690] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.014773] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.015458] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4f07f8c-58a0-4369-b9ed-00b0385fda59 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.015565] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.015629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.015968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.015968] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4f07f8c-58a0-4369-b9ed-00b0385fda59',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.517346] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1594.518425] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.518555] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.519384] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4f07f8c-58a0-4369-b9ed-00b0385fda59 with status ACTIVE [ 1594.519698] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.519822] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.519886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.520104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.520207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.520495] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.520495] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.520590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.520724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.520778] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.520951] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.521052] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.521108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.521241] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.521317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.521763] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4f07f8c-58a0-4369-b9ed-00b0385fda59 is going to be updated. [ 1594.541030] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1594.541172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1594.541250] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1594.541390] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1594.541560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.541753] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4f07f8c-58a0-4369-b9ed-00b0385fda59" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.020101] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1595.522559] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.522726] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.522797] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.523022] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.523119] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.523215] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b is going to be created. [ 1595.546983] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1595.547108] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1595.547176] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1595.547356] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1595.547508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1595.555698] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: UNINITIALIZED for 2s [ 1597.566257] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: SUCCESS [ 1597.566581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.566581] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.566749] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.566933] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.567061] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.567124] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.567276] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.567355] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.567438] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.567526] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.070321] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1598.573337] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e106e47e-73ee-46df-916b-9473e03b5a0b: rpc.has_security_group_logging(os_id): False [ 1598.590364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.590528] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.590590] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.590796] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.590882] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.591136] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.591236] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.591306] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.591487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.591553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.591640] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b is going to be created. [ 1598.647502] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1598.647618] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1598.647707] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1598.647832] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1598.648012] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1598.658055] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: IN_PROGRESS for 2s [ 1599.013405] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.013538] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1600.670524] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: SUCCESS [ 1600.670788] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1604.015293] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.015652] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.288280] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1606.288764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1606.288764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1606.288764] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1606.288863] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1606.791604] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.294602] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1607.796945] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1607.797179] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1608.494253] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.494636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.494636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.494636] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.631298] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1608.632155] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.633223] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1608.677890] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.677890] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.678055] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.678135] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.692154] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.692887] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1608.692978] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1608.693087] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1608.735211] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.735371] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.735418] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.735584] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.736291] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.736437] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1608.806049] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.806196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.806196] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.806389] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.806673] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.806902] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1608.874155] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.874315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.874359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.874539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.874803] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.875047] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:28. [ 1608.875141] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'609c743a-8d95-49f2-950a-deac8685a390', 'd77d69a7-8f25-4ac2-9118-a14cb208590e', '70472fc2-8f2e-4656-96c9-97081b657aa2', '2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e', 'a84f4511-52a2-43f2-996e-119d1f5c4dbd', 'cf911be5-2488-4f40-9c8d-53a9a8a05396', '2390abe6-0ba8-4ab0-8c91-187bd39ef80c', '3c88aae7-5837-4451-89b6-8972ab00f699', 'de342dad-fb8d-4c7b-87ea-595f01e3c6be', '8982c0b6-8a83-4e29-82e9-02c4a6ebebad', 'bd9acc22-8a8b-484a-8e94-b168c183d5d8', 'd49fbfa3-cbed-486e-8169-864e1a046ae7', '6dab7dc1-01c6-41fb-8400-c0b26437fd97', '6ce2faa2-25e1-421a-a969-531c3d6a9f5b', 'e106e47e-73ee-46df-916b-9473e03b5a0b', '5c1656bc-eaa3-40e0-9c81-d06925a9350d', '8022d569-fc48-4639-a726-38e4b078eac1', '39d08516-0c16-4674-ac9d-29023bc28795', '9adcb44b-15db-439a-8e0e-af687bcfa50b', 'a895e100-517f-40a3-99b4-4b43ee1bd032', '2b2d82cb-7e65-491f-8df0-d52a50997ba5', '538bdf43-fa07-48d1-906e-f7fa68a3a739', 'd0084e13-9513-4d73-a5ee-3f7440f23dd3', '320d8032-7c7f-4adf-9aaa-d27d0fb2efff', 'a84f0aee-549d-426e-90a7-d029d63ed8eb', '598796a3-3295-47ec-afb1-170cde7401b5', '4bb08130-5a7c-42ab-ad73-7aa2bef8cc7d', '50dc186b-34b2-45b3-89b7-2dfa7346dc41'} {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1608.875212] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1608.891848] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.891968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.892027] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.892188] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.892267] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.892362] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1608.892431] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1608.892498] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1608.965690] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1608.965843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1608.965843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1608.966047] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1608.967204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1608.967448] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1608.967527] env[69847]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69847) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1608.967598] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1608.967661] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1608.967736] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/28 resources of Type:Security Group Rules [ 1608.967809] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGH for action security_group_rules [ 1608.967884] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGH for action security_group_rules [ 1608.967949] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGH for action security_group_rules [ 1608.968019] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGH for action security_group_rules [ 1608.968079] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGH for action security_group_rules [ 1608.968135] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGH for action security_group_rules [ 1608.968196] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGH for action security_group_rules [ 1608.968256] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGH for action security_group_rules [ 1608.968314] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGH for action security_group_rules [ 1608.968367] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGH for action security_group_rules [ 1608.968433] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGH for action security_group_rules [ 1608.968548] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGH for action security_group_rules [ 1608.968548] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGH for action security_group_rules [ 1608.968641] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGH for action security_group_rules [ 1608.968641] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGH for action security_group_rules [ 1608.968731] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGH for action security_group_rules [ 1608.968760] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGH for action security_group_rules [ 1608.968809] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGH for action security_group_rules [ 1608.968864] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGH for action security_group_rules [ 1608.968923] env[69847]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGH for action security_group_rules [ 1608.969016] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.016504] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.016621] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1609.016779] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609c743a-8d95-49f2-950a-deac8685a390 with Priority: HIGH for action security_group_rules [ 1609.016950] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 with Priority: HIGH for action security_group_rules [ 1609.017114] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c with Priority: HIGH for action security_group_rules [ 1609.017260] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGH for action security_group_rules [ 1609.017406] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a895e100-517f-40a3-99b4-4b43ee1bd032 with Priority: HIGH for action security_group_rules [ 1609.017526] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b with Priority: HIGH for action security_group_rules [ 1609.017620] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d08516-0c16-4674-ac9d-29023bc28795 with Priority: HIGH for action security_group_rules [ 1609.017703] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8022d569-fc48-4639-a726-38e4b078eac1 with Priority: HIGH for action security_group_rules [ 1609.017788] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b with Priority: HIGH for action security_group_rules [ 1609.017867] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d with Priority: HIGH for action security_group_rules [ 1609.017946] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 with Priority: HIGH for action security_group_rules [ 1609.018041] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 with Priority: HIGH for action security_group_rules [ 1609.018125] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 with Priority: HIGH for action security_group_rules [ 1609.018203] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad with Priority: HIGH for action security_group_rules [ 1609.018288] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be with Priority: HIGH for action security_group_rules [ 1609.018367] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 with Priority: HIGH for action security_group_rules [ 1609.018463] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c88aae7-5837-4451-89b6-8972ab00f699 with Priority: HIGH for action security_group_rules [ 1609.018549] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd with Priority: HIGH for action security_group_rules [ 1609.018630] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d77d69a7-8f25-4ac2-9118-a14cb208590e with Priority: HIGH for action security_group_rules [ 1609.018711] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e with Priority: HIGH for action security_group_rules [ 1609.019061] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-609c743a-8d95-49f2-950a-deac8685a390 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.019257] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.019336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.019546] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.019657] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('609c743a-8d95-49f2-950a-deac8685a390',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.020787] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70472fc2-8f2e-4656-96c9-97081b657aa2 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.020910] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.020968] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.021132] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.021215] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70472fc2-8f2e-4656-96c9-97081b657aa2',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.022308] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.022430] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.022501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.022660] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.022734] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2390abe6-0ba8-4ab0-8c91-187bd39ef80c',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.023387] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.023494] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.023560] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.023709] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.023778] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.025307] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a895e100-517f-40a3-99b4-4b43ee1bd032 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.026036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.026036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.026036] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.026036] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a895e100-517f-40a3-99b4-4b43ee1bd032',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.026620] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9adcb44b-15db-439a-8e0e-af687bcfa50b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.026745] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.026804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.026953] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.027038] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9adcb44b-15db-439a-8e0e-af687bcfa50b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.027855] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d08516-0c16-4674-ac9d-29023bc28795 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.027855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.027855] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.028049] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.028049] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d08516-0c16-4674-ac9d-29023bc28795',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.028869] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8022d569-fc48-4639-a726-38e4b078eac1 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.028869] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.028987] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.029076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.029114] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8022d569-fc48-4639-a726-38e4b078eac1',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.029962] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.030101] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.030141] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.030292] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.030348] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2faa2-25e1-421a-a969-531c3d6a9f5b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.031252] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.031433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.031433] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.031604] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.031675] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c1656bc-eaa3-40e0-9c81-d06925a9350d',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.032477] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.032539] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.032614] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.032826] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.032826] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dab7dc1-01c6-41fb-8400-c0b26437fd97',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.033619] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d49fbfa3-cbed-486e-8169-864e1a046ae7 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.033619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.033619] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.033748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.033828] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d49fbfa3-cbed-486e-8169-864e1a046ae7',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.034656] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.034881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.034881] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.035091] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.035091] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd9acc22-8a8b-484a-8e94-b168c183d5d8',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.035941] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.036076] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.036139] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.036286] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.036349] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8982c0b6-8a83-4e29-82e9-02c4a6ebebad',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.037023] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.037120] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.037199] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.037408] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.037408] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de342dad-fb8d-4c7b-87ea-595f01e3c6be',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.038201] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf911be5-2488-4f40-9c8d-53a9a8a05396 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.038295] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.038415] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.038513] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.038581] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf911be5-2488-4f40-9c8d-53a9a8a05396',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.039319] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c88aae7-5837-4451-89b6-8972ab00f699 taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.039432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.039510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.039665] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.039736] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c88aae7-5837-4451-89b6-8972ab00f699',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.040411] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.040501] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.040640] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.040724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.040862] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a84f4511-52a2-43f2-996e-119d1f5c4dbd',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.041611] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d77d69a7-8f25-4ac2-9118-a14cb208590e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.041720] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.041773] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.041919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.041986] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d77d69a7-8f25-4ac2-9118-a14cb208590e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.042858] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.042923] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.042997] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.043194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.043268] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.066035] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.066165] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.066256] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.066446] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.068734] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.068840] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.081999] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.082127] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 609c743a-8d95-49f2-950a-deac8685a390 is going to be deleted. [ 1609.082885] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.083093] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.099223] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.099324] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8022d569-fc48-4639-a726-38e4b078eac1 is going to be deleted. [ 1609.135880] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.136044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.136088] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.136231] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.136314] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.136416] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-609c743a-8d95-49f2-950a-deac8685a390" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.145756] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.145862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.145928] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.146106] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.146189] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.146290] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8022d569-fc48-4639-a726-38e4b078eac1" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.554371] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.556044] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.556044] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.556044] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1609.603583] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.603748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.603787] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.603972] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.605491] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.605591] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.606969] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.607081] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.611286] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.611394] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.612067] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.612162] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.614362] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.614458] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.615246] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.615359] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.616069] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.616181] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.616894] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.616989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.617744] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.617847] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.618555] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.618650] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.619235] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.619632] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.619748] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.620375] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.620775] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.620886] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.621552] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.621953] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.622072] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.622665] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.623109] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.623212] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.623837] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.624257] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.624361] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.624959] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.625364] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.625472] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.626297] env[69847]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1609.626733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.626854] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d49fbfa3-cbed-486e-8169-864e1a046ae7 is going to be deleted. [ 1609.627697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.627896] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.642485] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.642571] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8982c0b6-8a83-4e29-82e9-02c4a6ebebad is going to be deleted. [ 1609.643334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.643510] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.657514] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.657613] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70472fc2-8f2e-4656-96c9-97081b657aa2 is going to be deleted. [ 1609.658312] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.658487] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.675454] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.675567] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dab7dc1-01c6-41fb-8400-c0b26437fd97 is going to be deleted. [ 1609.676261] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.676435] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.681475] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.681576] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.689702] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.689828] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.695203] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.695303] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9adcb44b-15db-439a-8e0e-af687bcfa50b is going to be deleted. [ 1609.695986] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.696172] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.706766] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.706874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.728831] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.728939] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c88aae7-5837-4451-89b6-8972ab00f699 is going to be deleted. [ 1609.729641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.729814] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.779950] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.780111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.785854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.785965] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2390abe6-0ba8-4ab0-8c91-187bd39ef80c is going to be deleted. [ 1609.786710] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.786897] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.831957] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.832070] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.834680] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.834784] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c1656bc-eaa3-40e0-9c81-d06925a9350d is going to be deleted. [ 1609.835521] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.835700] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.836917] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.837023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.898944] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1609.899111] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1609.906023] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.906147] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d08516-0c16-4674-ac9d-29023bc28795 is going to be deleted. [ 1609.906934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.907148] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1609.983363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1609.983578] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a84f4511-52a2-43f2-996e-119d1f5c4dbd is going to be deleted. [ 1609.984392] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1609.984605] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.052957] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.053125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.056648] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.056781] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e is going to be deleted. [ 1610.057641] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.057851] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.059740] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.059859] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.066124] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.109051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.109051] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2faa2-25e1-421a-a969-531c3d6a9f5b is going to be deleted. [ 1610.109051] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.109293] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.152584] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.152804] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.163275] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.163407] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf911be5-2488-4f40-9c8d-53a9a8a05396 is going to be deleted. [ 1610.164336] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.164563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.175821] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.175934] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.205284] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.205415] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de342dad-fb8d-4c7b-87ea-595f01e3c6be is going to be deleted. [ 1610.206194] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.206400] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.243318] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.243425] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a895e100-517f-40a3-99b4-4b43ee1bd032 is going to be deleted. [ 1610.244127] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.244317] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.284828] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.284961] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.285342] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.285451] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d77d69a7-8f25-4ac2-9118-a14cb208590e is going to be deleted. [ 1610.286207] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.286432] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.359369] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.359532] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd9acc22-8a8b-484a-8e94-b168c183d5d8 is going to be deleted. [ 1610.360272] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.360470] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.360596] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.360697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d49fbfa3-cbed-486e-8169-864e1a046ae7" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.360843] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.360989] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.361080] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.361190] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8982c0b6-8a83-4e29-82e9-02c4a6ebebad" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.361611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.361862] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.361945] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.362073] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70472fc2-8f2e-4656-96c9-97081b657aa2" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.362204] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.362345] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.362419] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.362529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dab7dc1-01c6-41fb-8400-c0b26437fd97" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.362651] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.362786] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.362858] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.362963] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9adcb44b-15db-439a-8e0e-af687bcfa50b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.363104] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.363240] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.363315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.363421] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c88aae7-5837-4451-89b6-8972ab00f699" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.363545] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.363682] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.363754] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.363854] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2390abe6-0ba8-4ab0-8c91-187bd39ef80c" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.363976] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.364125] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.364198] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.364303] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c1656bc-eaa3-40e0-9c81-d06925a9350d" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.364422] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.364556] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.364629] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.364732] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d08516-0c16-4674-ac9d-29023bc28795" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.364857] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.364991] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.365074] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.365180] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eb3f7e9-3b02-4b1a-8f78-1558d0ce392e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.365301] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.365434] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.365529] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.365607] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a84f4511-52a2-43f2-996e-119d1f5c4dbd" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.365724] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.365856] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.365926] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.366040] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2faa2-25e1-421a-a969-531c3d6a9f5b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.372483] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.372611] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.372661] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.372806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.372903] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.373017] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de342dad-fb8d-4c7b-87ea-595f01e3c6be" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.373762] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.373874] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.373939] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.374099] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.374177] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.374281] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf911be5-2488-4f40-9c8d-53a9a8a05396" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.374879] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.374977] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.375054] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.375201] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.375277] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.375378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a895e100-517f-40a3-99b4-4b43ee1bd032" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.461123] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.461252] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.461347] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.461476] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.461599] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.461697] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d77d69a7-8f25-4ac2-9118-a14cb208590e" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.517356] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.517492] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.517526] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.517719] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.517806] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.517919] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd9acc22-8a8b-484a-8e94-b168c183d5d8" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.568358] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e106e47e-73ee-46df-916b-9473e03b5a0b: rpc.has_security_group_logging(os_id): False [ 1610.590981] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.591113] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.591208] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.591363] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.622931] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.623216] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.623334] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.623420] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.623559] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.623638] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.623724] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b is going to be updated. [ 1610.694360] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.694515] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.694553] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.694733] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.694872] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.706903] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: IN_PROGRESS for 2s [ 1612.723353] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: SUCCESS [ 1612.723686] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1614.020055] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1614.020423] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.020927] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.021256] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1624.022324] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.022737] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.023386] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.023709] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.024298] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.024628] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.025958] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.026310] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.027816] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.027816] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.028551] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.028551] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1654.029449] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1654.029834] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.817309] env[69847]: INFO networking_nsxv3.common.synchronization [req-9ca63e77-af9a-4496-8dc8-a2f61b7a0d92 req-f1dd5771-9520-446f-bd4a-da6edc125ad1 tempest-AttachVolumeNegativeTest-1732222648 tempest-AttachVolumeNegativeTest-1732222648-project-member] Enqueued Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_members [ 1655.817826] env[69847]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e106e47e-73ee-46df-916b-9473e03b5a0b with Priority: HIGHEST for action security_group_members [ 1655.818125] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock member-e106e47e-73ee-46df-916b-9473e03b5a0b taken with stack trace [, , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.818248] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.818315] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.818508] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.819020] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1655.819152] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1655.819221] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1655.819378] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1655.819465] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1655.819555] env[69847]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e106e47e-73ee-46df-916b-9473e03b5a0b',) {} {{(pid=69847) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1656.321716] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.321902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.321902] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.322170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.322271] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.322464] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.322563] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.322624] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.322777] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.322852] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.322938] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b is going to be updated. [ 1656.363492] env[69847]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69847) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1656.363625] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1656.363669] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1656.363818] env[69847]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1656.363947] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1656.371890] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: IN_PROGRESS for 2s [ 1658.382784] env[69847]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e106e47e-73ee-46df-916b-9473e03b5a0b in Status: SUCCESS [ 1658.383170] env[69847]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e106e47e-73ee-46df-916b-9473e03b5a0b deletion is rescheduled due to dependency. [ 1658.383170] env[69847]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e106e47e-73ee-46df-916b-9473e03b5a0b" {{(pid=69847) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1660.819231] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.819628] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.821249] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.821556] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.822919] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.822919] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1675.824754] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1675.825189] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1680.825847] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1680.826214] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1685.827983] env[69847]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1685.827983] env[69847]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0